GPTQ models quantized with QuaRot.
Harry Chen
cymic
AI & ML interests
None yet
Recent Activity
updated a collection 4 days ago
QuaRot GPTQ Models updated a collection 4 days ago
QuaRot GPTQ Models updated a collection 4 days ago
QuaRot GPTQ ModelsOrganizations
models 19
cymic/llama2-7b-quarot-w8
7B • Updated • 9
cymic/llama2-7b-quarot-w4
7B • Updated • 8
cymic/llama2-7b-quarot-w3
7B • Updated • 10
cymic/llama2-13b-quarot-w8
13B • Updated • 7
cymic/llama2-13b-quarot-w4
13B • Updated • 7
cymic/llama2-13b-quarot-w3
13B • Updated • 9
cymic/qwen3-8b-sq-gptq-w8
8B • Updated • 9
cymic/qwen3-8b-sq-gptq-w4
8B • Updated • 10
cymic/qwen3-8b-sq-gptq-w3
8B • Updated • 10
cymic/llama3.1-8b-instruct-sq-gptq-w8
8B • Updated • 12 • 1