GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
AllThingsIntel-Apollo-V0.1-4B-Thinking-Q4_K_M
Qwen · AllThingsIntel
Params4B
Context256K
Q4_K_M2.5 GB
YI
Yi 34Bx2 MOE 200K
Yi · mradermacher
Params61B
Context195K
Q4_K_M37.2 GB
NE
NeutralWeirdness V1 24B Heretic
Neutralweirdness · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
KA
Kanana 1.5 15.7b A3B Instruct
Kanana · mradermacher
Params15.7B
Context32K
Q4_K_M10.4 GB
MA
magnum-72b-v1
Magnum · Quant-Cartel
Params72.7B
Context32K
Q4_K_M47.4 GB
TX
Txgemma 9b Chat
Txgemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
OP
OpenELM 1_1B Fix Nan
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
NE
Nemotron 3 Super 120B A12B Uncensored
Nemotron · timteh673
Params121B
Context1024K
Q4_K_M86.1 GB
QW
Qwen1.5-14B-Chat
Qwen · second-state
Params14.2B
Context32K
Q4_K_M9.2 GB
BA
ehartford_based-13b
Based · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
DR
Dracarys2 72B Instruct
Dracarys · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
codefuse-ai_codefuse-codellama-34b
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
CA
Captain Eris Violet GRPO v0.420 GGUF IQ Imatrix
Captain · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
CY
TheDrummer Cydonia 24B v2.1
Cydonia · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
OU
calderaai_13b-ouroboros
Ouroboros · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
QW
Qwen2.5 72B Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest23.7 GB
LF
lfm2.5 2.6b fable5 coding agent heretic
Lfm · AzariazIZI
Params2.7B
Context128K
Q4_K_M1.7 GB
CO
confucius4 r2t2
Confucius · cstr
Params2.35B
Context—
Smallest1.5 GB
SA
Dr.Samantha-8B
Samantha · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
CodeQwen1.5-7B-Chat
Qwen · second-state
Params7.25B
Context64K
Q4_K_M4.7 GB
NE
addis scribe streaming
Nemotron · addisai
Params99M
Context—
Smallest0.0 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · legraphista
Params4.51B
Context128K
Smallest1.8 GB
ZE
zephyr-7b-sft-full-SPIN-iter3
Zephyr · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B
Nemotron · natalie5
Params1.63B
Context1024K
Smallest1.3 GB
CH
chronos hermes 13b
Chronos · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
QW
Swift Qwen3.8 27b Terse Coder
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
LL
suzume llama 3 8B multilingual
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
FA
Falcon-H1-1.5B-Instruct
Falcon · unsloth
Params1.55B
Context128K
Q4_K_M0.9 GB
QW
Qwen2.5 14B Instruct 1M
Qwen · duyntnet
Params14.8B
Context986K
Q4_K_M9.0 GB
DE
DeepSeek-V2-Lite-Chat
DeepSeek · second-state
Params15.7B
Context160K
Q4_K_M10.4 GB