allenai

/

OLMo-2-1124-7B-GGUF

Like 4

Follow

Ai2 6.96k

Hey @KeyboardMasher , here's the link to instruct version: https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct

Yes, I've seen those. Those are not GGUF files.
Meanwhile @bartowski already made -Instruct GGUFs.

We are working out some issues with the tokenization and its implications on the GGUF files (https://github.com/ggerganov/llama.cpp/pull/10535). We will put up official files when they are sorted out. In the meantime, you are welcome to use those instruct GGUFs if they work for you (with the caveat that they might not match the non-GGUF version).