GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
QW
UnifiedReward Edit Qwen3Vl 8b
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
OR
Ornith 1.5 35B A3B REAP50
Ornith · Atomic-Germ
Params18.5B
Context256K
Smallest0.2 GB
TI
TinyLlama 1.1B intermediate 1.5T PTBR Instruct v0
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
RL
RLinf Math 7B
Rlinf · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DI
Dirty Alice Tiny 1.1B V2 Chatml i1
Dirty · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
CA
CAI 20B v2
Cai · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
DE
DeepSeek R1 ReDistill Qwen 7B v1.1 i1
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LI
Ling 3.0 Flash
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
VO
UI Voyager
Voyager · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
OC
OceanGPT Basic 7B v0.3
Oceangpt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
KI
Huihui Kimi Linear REAP 35B A3B Instruct Abliterated
Kimi · mradermacher
Params35.1B
Context1024K
Q4_K_M21.3 GB
BI
bitnet b1.58 2B 4T tq2 0
Bitnet · Synapticode
Params2.41B
Context4K
Smallest1.2 GB
LI
Ling 3.0 Flash
Ling · prometheusAIR
Params127B
Context256K
Q4_K_M74.8 GB
PH
Phi 4 Reasoning Plus
Phi · second-state
Params14.7B
Context32K
Q4_K_M9.1 GB
R1
R1 1776
unsloth
Params671B
Context160K
Q4_K_M404.4 GB
NU
NuMarkdown-8B-Thinking
Numarkdown · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
UnifiedReward Flex Qwen3Vl 32b
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
NE
nenad1002 quantum research bot v1.0
Nenad · RichardErkhov
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
Deepreinforce ai_Ornith 1.0 35B
Ornith · lmstudio-community
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
MiMo-V2.6-Pro-RL
Mimo · pcuenq
Params1020B
Context1024K
Smallest2.1 GB
LL
LLaMAX2 7B XNLI
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
PO
Polyglot Lion 1.7b v1.5
Polyglot · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
NO
Nous Capybara 7B V1.9 i1
Nous · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 Psychological Reasoning 4B
Qwen · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
TI
TinyPi Chat V1
Tinypi · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
BI
BioQwen-1.8B
Bioqwen · mradermacher
Params1.84B
Context32K
Q4_K_M1.2 GB
QW
qwen3.5 9B ctf web instruct
Qwen · chinatigerking
Params9.2B
Context256K
Smallest9.8 GB
TO
ToriiGate 0.5
Toriigate · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
AG
Agent STAR RL 7B
Agent · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
FI
fietje 2 chat i1
Fietje · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB