Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2405.03594

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

31

Base only

Active filters: 2405.03594

RedHatAI/Llama-2-7b-pruned50-retrained

Text Generation • 7B • Updated May 7, 2024 • 64

RedHatAI/Llama-2-7b-pruned70-retrained

Text Generation • 7B • Updated May 7, 2024 • 71 • 1

RedHatAI/Llama-2-7b-ultrachat200k

Text Generation • 7B • Updated May 7, 2024 • 105 • 1

RedHatAI/Llama-2-7b-ultrachat200k-pruned_50

Text Generation • 7B • Updated May 15, 2024 • 30

RedHatAI/Llama-2-7b-ultrachat200k-pruned_70

Text Generation • 7B • Updated May 15, 2024 • 23

RedHatAI/Llama-2-7b-ultrachat200k-pruned_50-quantized-deepsparse

Text Generation • Updated May 7, 2024 • 26

RedHatAI/Llama-2-7b-ultrachat200k-pruned_70-quantized-deepsparse

Text Generation • Updated May 15, 2024 • 25

RedHatAI/Llama-2-7b-evolcodealpaca

Text Generation • 7B • Updated May 7, 2024 • 25 • 1

RedHatAI/Llama-2-7b-evol-code-alpaca-pruned_50

Text Generation • 7B • Updated May 15, 2024 • 32

RedHatAI/Llama-2-7b-evol-code-alpaca-pruned_70

Text Generation • 7B • Updated May 15, 2024 • 23

RedHatAI/Llama-2-7b-evol-code-alpaca-pruned_50-quantized-deepsparse

Text Generation • Updated May 15, 2024 • 21

RedHatAI/Llama-2-7b-evol-code-alpaca-pruned_70-quantized-deepsparse

Text Generation • Updated May 15, 2024 • 24

RedHatAI/Llama-2-7b-dolphin-open_platypus

Text Generation • 7B • Updated May 15, 2024 • 17

RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_50

Text Generation • 7B • Updated May 15, 2024 • 22

RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_70

Text Generation • 7B • Updated May 15, 2024 • 21

RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_50-quantized-deepsparse

Text Generation • Updated May 16, 2024 • 28

RedHatAI/Llama-2-7b-dolphin-open_platypus-pruned_70-quantized-deepsparse

Text Generation • Updated May 16, 2024 • 22 • 1

RichardErkhov/neuralmagic_-_Llama-2-7b-evolcodealpaca-4bits

Text Generation • 7B • Updated May 10, 2024 • 6

RichardErkhov/neuralmagic_-_Llama-2-7b-evolcodealpaca-8bits

Text Generation • 7B • Updated May 10, 2024 • 19

RichardErkhov/neuralmagic_-_Llama-2-7b-evolcodealpaca-gguf

7B • Updated May 10, 2024 • 1.71k

RedHatAI/Llama-2-7b-gsm8k-pruned_50

Text Generation • 7B • Updated Jun 20, 2024 • 16 • 1

RedHatAI/Llama-2-7b-gsm8k-pruned_70

Text Generation • 7B • Updated Jun 20, 2024 • 25

RedHatAI/Llama-2-7b-gsm8k

Text Generation • Updated Jun 20, 2024 • 31 • 5

RichardErkhov/neuralmagic_-_Llama-2-7b-dolphin-open_platypus-pruned_70-gguf

7B • Updated Jul 16, 2024 • 282

RichardErkhov/neuralmagic_-_Llama-2-7b-pruned50-retrained-gguf

7B • Updated Sep 13, 2024 • 906

RichardErkhov/neuralmagic_-_Llama-2-7b-ultrachat200k-gguf

7B • Updated Sep 13, 2024 • 1.48k

RichardErkhov/neuralmagic_-_Llama-2-7b-pruned70-retrained-gguf

7B • Updated Nov 17, 2024 • 442

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic

Text Generation • 8B • Updated Dec 19, 2024 • 32 • 1

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16

Text Generation • 2B • Updated Dec 19, 2024 • 27 • 3

RedHatAI/Sparse-Llama-3.1-8B-ultrachat_200k-2of4

Text Generation • 8B • Updated Nov 21, 2024 • 92 • • 1