NbAiLab/nb-llama-3.2-1B-Q4_K_M-GGUF
Text Generation • 1B • Updated
• 9
NB-Llama 3.x Quant
Quantized version of the NB-Llama 3.x models. Due to hardware issues, we have still not been able to make quantized version of the 70B models.
-
-
NbAiLab/nb-llama-3.2-3B-Q4_K_M-GGUF
Text Generation • 3B • Updated • 13 -
NbAiLab/nb-llama-3.1-8B-Q4_K_M-GGUF
Text Generation • 8B • Updated • 52 • 1 -
NbAiLab/nb-llama-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation • 1B • Updated • 16 -
NbAiLab/nb-llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 19 -
NbAiLab/nb-llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation • 8B • Updated • 49 • 1