YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
LLM matefi
A fine-tuned TinyLlama 1.1B model for German & English Q&A. Quantized with llama.cpp to Q5_K_M.
Usage (llama.cpp)
./llama-cli -m LLM-matefi.Q5_K_M.gguf -c 2048 -n 256 -p "<|system|>\nReply in German or English.\n<|user|>\nWhat is PowerShell?\n<|assistant|>\n"
Usage (.NET with LLamaSharp)
dotnet run -- "C:\models\LLM-matefi.Q5_K_M.gguf"
- Downloads last month
- 1
Hardware compatibility
Log In
to view the estimation
5-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support