GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
gpt2 GGUF smashed
Gpt · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB
GGUF
LI
Ling 3.0 Flash Heretic
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
GGUF
DE
DeepSeek V4.1 Flash ik llama
DeepSeek · pokey2025
Params14.2B
Context—
Smallest7.9 GB
GGUF
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
UN
Unlimited OCR 2
Unlimited · RX5950XT
Params2.94B
Context128K
Q4_K_M2.2 GB
GGUF
YI
Faro Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
LI
Ling 3.0 flash VL
Ling · bloomer010
Params124B
Context256K
Q4_K_M0.7 GB
Vision
PH
Phi 4 Mini Reasoning
Phi · bartowski
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingReasoning
MU
Murasaki Backup
Murasaki · shoutmon
Params14.8B
Context32K
Smallest3.6 GB
GGUF
AI
Aiaudiotranslate
Aiaudiotranslate · Anthropic-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
OR
Ornith 1.5 35B A3B DFlash
Ornith · na0x2c6
Params386M
Context256K
Smallest0.4 GB
GGUF
MI
teknium_airoboros-mistral2.2-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
severian_anima-phi-neptune-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MiMo V2.6 Flash RL UNCENSORED IQ2S Down
Mimo · BattleGhost
Params310B
Context1024K
Smallest91.7 GB
ReasoningTool use
OR
Ornith 1.0 397B
Ornith · unsloth
Params397B
Context256K
Q4_K_M245.0 GB
GGUF
LL
ultravox v0 5 llama 3 1 8b
Llama · ggml-org
Params8B
Context128K
Q4_K_M4.9 GB
Vision
PH
Unsloth Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.9 GB
GGUF
SP
SpydazWeb_AI_LCARS_Humanization_003
Spydazweb · mradermacher
Params7.24B
Context512K
Q4_K_M4.4 GB
Coding
SE
Seed-Coder-8B-Instruct
Seed · unsloth
Params8.25B
Context32K
Q4_K_M5.1 GB
Coding
GL
GLM 4.5 Air
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
GGUF
OR
Tiel Coder 35B A3B Genesis Hermes
Ornith · LuffyTheFox
Params34.7B
Context256K
Smallest20.2 GB
CodingTool useVision
LL
Ornith 1.0 35B
Llama · LordNeel
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
PE
Peach 9B 8k Roleplay
Peach · bartowski
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
DE
DeepSeek V4.1 Flash 1017 dsx mxfp4
DeepSeek · lxe
Params—
Context—
Smallest270.5 GB
GGUF
IR
Irodori-TTS-v4.1-Small-MF
Irodori · sakasegawa
Params866M
Context—
Smallest0.9 GB
GGUF
DE
Deepseek-V3.1-Terminus
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
GGUF
LI
Ling 3.0 Flash Sante
Ling · bartowski
Params127B
Context256K
Q4_K_M80.4 GB
ReasoningTool use
HI
HiDream O1 Image Dev
Hidream · smthem
Params8.8B
Context—
Smallest9.9 GB
GGUF
GL
GLM 5.3 Flash
GLM · batiai
Params313B
Context1024K
Q4_K_M188.7 GB
GGUF
AL
ALMA 13B Pretrain
Alma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing