GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
AllThingsIntel-Apollo-V0.1-4B-Thinking-Q4_K_M
Qwen · AllThingsIntel
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
YI
Yi 34Bx2 MOE 200K
Yi · mradermacher
Params61B
Context195K
Q4_K_M37.2 GB
GGUF
NE
NeutralWeirdness V1 24B Heretic
Neutralweirdness · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
KA
Kanana 1.5 15.7b A3B Instruct
Kanana · mradermacher
Params15.7B
Context32K
Q4_K_M10.4 GB
Tool use
MA
magnum-72b-v1
Magnum · Quant-Cartel
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
TX
Txgemma 9b Chat
Txgemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
OP
OpenELM 1_1B Fix Nan
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
NE
Nemotron 3 Super 120B A12B Uncensored
Nemotron · timteh673
Params121B
Context1024K
Q4_K_M86.1 GB
GGUF
QW
Qwen1.5-14B-Chat
Qwen · second-state
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
BA
ehartford_based-13b
Based · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
DR
Dracarys2 72B Instruct
Dracarys · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
LL
codefuse-ai_codefuse-codellama-34b
Llama · TheBloke
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
CA
Captain Eris Violet GRPO v0.420 GGUF IQ Imatrix
Captain · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
CY
TheDrummer Cydonia 24B v2.1
Cydonia · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
OU
calderaai_13b-ouroboros
Ouroboros · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
QW
Qwen2.5 72B Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest23.7 GB
Tool use
LF
lfm2.5 2.6b fable5 coding agent heretic
Lfm · AzariazIZI
Params2.7B
Context128K
Q4_K_M1.7 GB
Tool use
CO
confucius4 r2t2
Confucius · cstr
Params2.35B
Context—
Smallest1.5 GB
GGUF
SA
Dr.Samantha-8B
Samantha · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
CodeQwen1.5-7B-Chat
Qwen · second-state
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
NE
addis scribe streaming
Nemotron · addisai
Params99M
Context—
Smallest0.0 GB
GGUF
LL
Llama 3.1 Minitron 4B Width Base
Llama · legraphista
Params4.51B
Context128K
Smallest1.8 GB
GGUF
ZE
zephyr-7b-sft-full-SPIN-iter3
Zephyr · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B
Nemotron · natalie5
Params1.63B
Context1024K
Smallest1.3 GB
Vision
CH
chronos hermes 13b
Chronos · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
Tool use
QW
Swift Qwen3.8 27b Terse Coder
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoning
LL
suzume llama 3 8B multilingual
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
FA
Falcon-H1-1.5B-Instruct
Falcon · unsloth
Params1.55B
Context128K
Q4_K_M0.9 GB
GGUF
QW
Qwen2.5 14B Instruct 1M
Qwen · duyntnet
Params14.8B
Context986K
Q4_K_M9.0 GB
GGUF
DE
DeepSeek-V2-Lite-Chat
DeepSeek · second-state
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding

Keep browsing