GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
GP
gpt2 GGUF smashed
Gpt · PrunaAI
Params163M
Context1K
Q4_K_M0.1 GB
LI
Ling 3.0 Flash Heretic
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
DE
DeepSeek V4.1 Flash ik llama
DeepSeek · pokey2025
Params14.2B
Context—
Smallest7.9 GB
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.4 GB
UN
Unlimited OCR 2
Unlimited · RX5950XT
Params2.94B
Context128K
Q4_K_M2.2 GB
YI
Faro Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
LI
Ling 3.0 flash VL
Ling · bloomer010
Params124B
Context256K
Q4_K_M0.7 GB
PH
Phi 4 Mini Reasoning
Phi · bartowski
Params3.84B
Context128K
Q4_K_M2.5 GB
MU
Murasaki Backup
Murasaki · shoutmon
Params14.8B
Context32K
Smallest3.6 GB
AI
Aiaudiotranslate
Aiaudiotranslate · Anthropic-ai
Params8.95B
Context256K
Q4_K_M5.6 GB
OR
Ornith 1.5 35B A3B DFlash
Ornith · na0x2c6
Params386M
Context256K
Smallest0.4 GB
MI
teknium_airoboros-mistral2.2-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
severian_anima-phi-neptune-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiMo V2.6 Flash RL UNCENSORED IQ2S Down
Mimo · BattleGhost
Params310B
Context1024K
Smallest91.7 GB
OR
Ornith 1.0 397B
Ornith · unsloth
Params397B
Context256K
Q4_K_M245.0 GB
LL
ultravox v0 5 llama 3 1 8b
Llama · ggml-org
Params8B
Context128K
Q4_K_M4.9 GB
PH
Unsloth Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.9 GB
SP
SpydazWeb_AI_LCARS_Humanization_003
Spydazweb · mradermacher
Params7.24B
Context512K
Q4_K_M4.4 GB
SE
Seed-Coder-8B-Instruct
Seed · unsloth
Params8.25B
Context32K
Q4_K_M5.1 GB
GL
GLM 4.5 Air
GLM · bartowski
Params110B
Context128K
Q4_K_M73.5 GB
OR
Tiel Coder 35B A3B Genesis Hermes
Ornith · LuffyTheFox
Params34.7B
Context256K
Smallest20.2 GB
LL
Ornith 1.0 35B
Llama · LordNeel
Params34.7B
Context256K
Q4_K_M21.2 GB
PE
Peach 9B 8k Roleplay
Peach · bartowski
Params8.83B
Context16K
Q4_K_M5.3 GB
DE
DeepSeek V4.1 Flash 1017 dsx mxfp4
DeepSeek · lxe
Params—
Context—
Smallest270.5 GB
IR
Irodori-TTS-v4.1-Small-MF
Irodori · sakasegawa
Params866M
Context—
Smallest0.9 GB
DE
Deepseek-V3.1-Terminus
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
LI
Ling 3.0 Flash Sante
Ling · bartowski
Params127B
Context256K
Q4_K_M80.4 GB
HI
HiDream O1 Image Dev
Hidream · smthem
Params8.8B
Context—
Smallest9.9 GB
GL
GLM 5.3 Flash
GLM · batiai
Params313B
Context1024K
Q4_K_M188.7 GB
AL
ALMA 13B Pretrain
Alma · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB