Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

arxiv: 2310.08659

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

26

Base only

Active filters: 2310.08659

LoftQ/Llama-2-7b-hf-4bit-64rank

Text Generation • 7B • Updated May 3, 2024 • 33 • 1

LoftQ/Llama-2-13b-hf-4bit-64rank

Text Generation • 13B • Updated Dec 19, 2023 • 9 • 2

LoftQ/Llama-2-70b-hf-4bit-64rank

Text Generation • 69B • Updated May 3, 2024 • 9 • 1

LoftQ/Mistral-7B-v0.1-4bit-32rank

Text Generation • 7B • Updated Dec 20, 2023 • 5

LoftQ/Mistral-7B-v0.1-4bit-64rank

Text Generation • 7B • Updated Apr 18, 2024 • 20 • 1

LoftQ/Llama-2-7b-hf-fp16-64rank-gsm8k

Updated Dec 20, 2023 • 7

LoftQ/phi-2-4bit-64rank

Text Generation • 3B • Updated Aug 15, 2024 • 16

LoftQ/Meta-Llama-3-8B-4bit-64rank

Text Generation • 8B • Updated May 3, 2024 • 19 • 2

LoftQ/CodeLlama-7b-hf-4bit-64rank

Text Generation • 7B • Updated Apr 20, 2024 • 13

LoftQ/CodeLlama-13b-hf-4bit-64rank

Text Generation • 13B • Updated Apr 20, 2024 • 18

LoftQ/Meta-Llama-3-8B-Instruct-4bit-64rank

Text Generation • 8B • Updated May 3, 2024 • 22 • 2

LoftQ/Meta-Llama-3-70B-4bit-64rank-1iter

Text Generation • 72B • Updated Apr 21, 2024 • 31 • 2

LoftQ/Meta-Llama-3-70B-4bit-64rank

Text Generation • 72B • Updated May 3, 2024 • 16 • 1

LoftQ/Meta-Llama-3-70B-Instruct-4bit-64rank

Text Generation • 72B • Updated May 3, 2024 • 10 • 1

LoftQ/Phi-3-mini-128k-instruct-4bit-64rank

Text Generation • 4B • Updated May 3, 2024 • 19

LoftQ/Phi-3-mini-4k-instruct-4bit-64rank

Text Generation • 4B • Updated May 3, 2024 • 8

anamikac2708/Llama3-8b-LoftQ-finetuned-investopedia-Lora-Adapters

Updated Jun 18, 2024

RichardErkhov/LoftQ_-_Llama-2-13b-hf-4bit-64rank-gguf

13B • Updated Aug 12, 2024 • 1.81k

RichardErkhov/LoftQ_-_Mistral-7B-v0.1-4bit-32rank-gguf

7B • Updated Aug 18, 2024 • 1.16k

RichardErkhov/LoftQ_-_Mistral-7B-v0.1-4bit-32rank-4bits

7B • Updated Oct 18, 2024 • 4

RichardErkhov/LoftQ_-_Mistral-7B-v0.1-4bit-32rank-8bits

7B • Updated Oct 18, 2024 • 12

RichardErkhov/LoftQ_-_Llama-2-13b-hf-4bit-64rank-4bits

13B • Updated Oct 26, 2024 • 26

RichardErkhov/LoftQ_-_phi-2-4bit-64rank-gguf

3B • Updated Oct 30, 2024 • 149

RichardErkhov/LoftQ_-_phi-2-4bit-64rank-4bits

3B • Updated Oct 30, 2024 • 4

RichardErkhov/LoftQ_-_phi-2-4bit-64rank-8bits

3B • Updated Oct 30, 2024 • 4

karthik-a/sparkflashxgemma4

Text Generation • Updated Sep 27