5.01 BPW iMatrix/NVFP4 GGUF, embedded MTP, 262144 ctx on one 24 GB card, 50.44 tok/s. Recipe: piszczek.pl/blog/qwen38-27b-256k-50-tps-24gb-gpu
Michał Piszczek
cdiamond
·
AI & ML interests
CTO of Archdesk · Founder: Lextron.ai, Inclify, Rejsomat.pl, Robotero · Autonomous AI agents · AI reliability · Software architecture · ConstructionTech · Proof-Adjusted Autonomy · Joule Wars
Recent Activity
updated a collection 1 day ago
Qwen3.8 27B at 256K on 24 GB