GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiMo VL 7B RL 2508
Mimo · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
GL
Glm-Z1-32B-0414
GLM · unsloth
Params32.6B
Context32K
Q4_K_M19.7 GB
GGUF
PE
Peach 2.0 9B 8k Roleplay
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
MO
Moonshine Base
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GGUF
PH
phi 2 layla v1 chatml
Phi · l3utterfly
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
DE
DeepSeek R1
DeepSeek · bartowski
Params671B
Context160K
Q4_K_M404.4 GB
Reasoning
PH
Phi-4-Reasoning
Phi · unsloth
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
MI
MiMo 7B RL
Mimo · jedisct1
Params7.6B
Context32K
Q4_K_M4.7 GB
Reasoning
MA
MAmmoTH 70B
Mammoth · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MI
rossascends_mistral_7b_dolphin2.1_lima0.5_fp16
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GL
GLM 5.3 Flash
GLM · AesSedai
Params321B
Context1024K
Q4_K_M202.0 GB
Vision
MA
MAmmoTH2-8B-Plus
Mammoth · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GA
GaMS3 12B Multimodal
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
YI
Faro Yi 34B DPO
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
GE
Gemma 4 Rust Coder
Gemma · MassivDash
Params4.65B
Context128K
Q4_K_M3.4 GB
CodingVision
NU
nucleusai_nucleus-22b-token-500b
Nucleus · TheBloke
Params21.8B
Context2K
Q4_K_M13.2 GB
GGUF
GP
Gpt2 Xl
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · acrogenesis
Params748B
Context1024K
Smallest359.3 GB
GGUF
QW
qwen3.5 4B typescript coder
Qwen · MassivDash
Params4.2B
Context256K
Q4_K_M2.7 GB
CodingVision
OR
Ornith 1.5 9B DFlash
Ornith · abenzerps
Params1.29B
Context256K
Q4_K_M0.8 GB
Reasoning
DE
ultratensor models
DeepSeek · NagusameCS
Params73.8B
Context1024K
Smallest17.1 GB
GGUF
MI
Mr Grammatology clinical problems Mistral 7B 0.5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MO
Moonshine Tiny
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
GGUF
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
MI
Flirty Mistral
Mistral · mradermacher
Params7.3B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ornith 1.0 35B NVFP4 MTP
Ornith · s-batman
Params35.5B
Context256K
Smallest20.3 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 7B Abliterated Obliteratus
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
QW
ReSearch Qwen 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
JI
JiRackUltra_14b
Jirackultra · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
AT
Athena-CodePhi-7B-4k-v0.1
Athena · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
Coding

Keep browsing