GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
UnifiedReward Edit Qwen3Vl 8b
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
OR
Ornith 1.5 35B A3B REAP50
Ornith · Atomic-Germ
Params18.5B
Context256K
Smallest0.2 GB
GGUF
TI
TinyLlama 1.1B intermediate 1.5T PTBR Instruct v0
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
RL
RLinf Math 7B
Rlinf · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
DI
Dirty Alice Tiny 1.1B V2 Chatml i1
Dirty · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
CA
CAI 20B v2
Cai · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Tool use
DE
DeepSeek R1 ReDistill Qwen 7B v1.1 i1
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
LI
Ling 3.0 Flash
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
ReasoningTool use
VO
UI Voyager
Voyager · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
OC
OceanGPT Basic 7B v0.3
Oceangpt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
KI
Huihui Kimi Linear REAP 35B A3B Instruct Abliterated
Kimi · mradermacher
Params35.1B
Context1024K
Q4_K_M21.3 GB
Tool use
BI
bitnet b1.58 2B 4T tq2 0
Bitnet · Synapticode
Params2.41B
Context4K
Smallest1.2 GB
GGUF
LI
Ling 3.0 Flash
Ling · prometheusAIR
Params127B
Context256K
Q4_K_M74.8 GB
ReasoningTool use
PH
Phi 4 Reasoning Plus
Phi · second-state
Params14.7B
Context32K
Q4_K_M9.1 GB
Reasoning
R1
R1 1776
unsloth
Params671B
Context160K
Q4_K_M404.4 GB
CodingReasoningTool use
NU
NuMarkdown-8B-Thinking
Numarkdown · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningVision
QW
UnifiedReward Flex Qwen3Vl 32b
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Tool use
NE
nenad1002 quantum research bot v1.0
Nenad · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
OR
Deepreinforce ai_Ornith 1.0 35B
Ornith · lmstudio-community
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
MI
MiMo-V2.6-Pro-RL
Mimo · pcuenq
Params1020B
Context1024K
Smallest2.1 GB
ReasoningTool useVision
LL
LLaMAX2 7B XNLI
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PO
Polyglot Lion 1.7b v1.5
Polyglot · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
Vision
NO
Nous Capybara 7B V1.9 i1
Nous · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 Psychological Reasoning 4B
Qwen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
ReasoningTool use
TI
TinyPi Chat V1
Tinypi · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
BI
BioQwen-1.8B
Bioqwen · mradermacher
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
QW
qwen3.5 9B ctf web instruct
Qwen · chinatigerking
Params9.2B
Context256K
Smallest9.8 GB
ReasoningTool use
TO
ToriiGate 0.5
Toriigate · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool useVision
AG
Agent STAR RL 7B
Agent · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
FI
fietje 2 chat i1
Fietje · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF

Keep browsing