GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
Phi 4 Reasoning Plus
Phi · bartowski
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
MI
MiMo-V2.6-Flash-MOPD
Mimo · ddh0
Params310B
Context1024K
Smallest131.4 GB
ReasoningTool useVision
GP
gpt2 i1
Gpt · mradermacher
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
TI
tinyllama split test
Tinyllama · ngxson
Params24M
Context—
Smallest0.0 GB
GGUF
GL
GLM 4.7 Flash Name NSFW
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
AS
astrollama 3 8b chat aic i1
Astrollama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
AS
astrollama 2 70b chat aic i1
Astrollama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
MO
Moonlight 16B A3B Instruct
Moonlight · gabriellarson
Params16B
Context8K
Q4_K_M10.5 GB
GGUF
GP
Gpt Oss Sanguine 20b v1
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
CodingReasoningRoleplay
QW
Qwen3 30B A3B ERP v0.1
Qwen · Aratako
Params30.5B
Context32K
Q4_K_M18.6 GB
GGUF
OR
Ornith-1.5-35B-A3B
Ornith · lmcoleman
Params35.5B
Context256K
Q4_K_M21.0 GB
Vision
MI
MiMo V2.6 Flash REAP50
Mimo · patrickbdevaney
Params157B
Context1024K
Smallest2.4 GB
ReasoningTool useVision
QW
Roblox Coder v2
Qwen · preferedev
Params4.33B
Context256K
Q4_K_M2.8 GB
CodingVision
FR
FrogNano 4B 2609 Heretic
Frognano · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
OR
Ornith 1.0 35B Uncensored Heretic
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
VI
VibeThinker 3B
Vibethinker · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoning
GL
GLM-ASR-Nano-2512
GLM · Mungert
Params1.59B
Context8K
Q4_K_M1.1 GB
GGUF
TO
ToriiGate 0.5
Toriigate · DraconicDragon
Params4.84B
Context256K
Q4_K_M3.1 GB
Vision
QW
Qwen3.8 4B Agentic Distill
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
FR
FrogNano 4B 2609
Frognano · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
OR
Ornith 1.5 9B Heretic
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
DE
Deepseek-Tng-R1T2-Chimera
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
GGUF
NU
NuExtract v1.5
Nuextract · lmstudio-community
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
NO
Nous Puffin 70B i1
Nous · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
CH
Chocolatine 3B Instruct DPO Revised Q4 K M
Chocolatine · jpacifico
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B uncensored
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
EL
Elephant 1
Elephant · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
LL
tiny random LlamaForCausalLM
Llama · aladar
Params1M
Context2K
Smallest0.0 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · second-state
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding

Keep browsing