GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
MI
MiMo VL 7B RL 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
GL
Glm-Z1-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
PE
Peach 2.0 9B 8k Roleplay
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
MO
Moonshine Base
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
PH
phi 2 layla v1 chatml
Phi · l3utterfly
Params2.78B
Context2K
Q4_K_M1.7 GB
DE
DeepSeek R1
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M404.4 GB
PH
Phi-4-Reasoning
Phi · unsloth
Params14.7B
Context32K
Q4_K_M9.1 GB
MI
MiMo 7B RL
Mimo · jedisct1
Params7.6B
Context32K
Q4_K_M4.7 GB
MA
MAmmoTH 70B
Mammoth · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
MI
rossascends_mistral_7b_dolphin2.1_lima0.5_fp16
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
GLM 5.3 Flash
GLM · AesSedai
Params321B
Context1024K
Q4_K_M202.0 GB
MA
MAmmoTH2-8B-Plus
Mammoth · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GA
GaMS3 12B Multimodal
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
YI
Faro Yi 34B DPO
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GE
Gemma 4 Rust Coder
Gemma · MassivDash
Params4.65B
Context128K
Q4_K_M3.4 GB
NU
nucleusai_nucleus-22b-token-500b
Nucleus · TheBloke
Params21.8B
Context2K
Q4_K_M13.2 GB
GP
Gpt2 Xl
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · acrogenesis
Params748B
Context1024K
Smallest359.3 GB
QW
qwen3.5 4B typescript coder
Qwen · MassivDash
Params4.2B
Context256K
Q4_K_M2.7 GB
OR
Ornith 1.5 9B DFlash
Ornith · abenzerps
Params1.29B
Context256K
Q4_K_M0.8 GB
DE
ultratensor models
DeepSeek · NagusameCS
Params73.8B
Context1024K
Smallest17.1 GB
MI
Mr Grammatology clinical problems Mistral 7B 0.5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MO
Moonshine Tiny
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
MI
Flirty Mistral
Mistral · mradermacher
Params7.3B
Context32K
Q4_K_M4.4 GB
OR
Ornith 1.0 35B NVFP4 MTP
Ornith · s-batman
Params35.5B
Context256K
Smallest20.3 GB
DE
DeepSeek R1 Distill Qwen 7B Abliterated Obliteratus
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
ReSearch Qwen 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
JI
JiRackUltra_14b
Jirackultra · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
AT
Athena-CodePhi-7B-4k-v0.1
Athena · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB