GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
JA
Janus Pro 7B LM
Janus · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
PH
Phi 3.5 Mini Instruct
Phi · AcerTest359
Params3.82B
Context128K
Q4_K_M2.4 GB
NE
Nexus IKM RolePlay StoryWriter Hermes 2 Pro 7B
Nexus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Karma Electric R1Distill Llama 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
Ornith 1.5 35B A3B UNCENSORED
Ornith · therickcain
Params35.5B
Context256K
Q4_K_M21.7 GB
DE
DeepSWE Preview
Deepswe · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
HO
Holland 4B V1 i1
Holland · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
MI
mistral orpo capybara 7k
Mistral · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Microsoft Fara 7B
Fara · batiai
Params7.62B
Context125K
Q4_K_M4.7 GB
GP
Model Openai Community Gpt2 Xl Cache
Gpt · Alcoft
Params1.64B
Context1K
Q4_K_M1.2 GB
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · esc4late
Params29.9B
Context198K
Q4_K_M18.5 GB
UN
unlimited ocr 2 ru
Unlimited · p4ulbr4dl3y
Params2.94B
Context128K
Q4_K_M2.1 GB
GL
GLM Z1 9B 0414
GLM · mradermacher
Params9.4B
Context32K
Q4_K_M6.2 GB
MI
Mistral 7B v0.1 Flashback v2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek R1 Qwen3 8B Abliterated
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
QW
Qwen3-4B-DFlash-b16
Qwen · Anbeeld
Params537M
Context40K
Q4_K_M0.3 GB
PH
phi2 haiku ita v0.2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
SY
SynLogic Mix 3 32B
Synlogic · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
SE
Seed Coder 8B Reasoning
Seed · mradermacher
Params8.25B
Context64K
Q4_K_M5.1 GB
QW
Qwen 7B toolcalling ReSearch gguf Q8 0 codex
Qwen · Manojb
Params7.62B
Context128K
Smallest8.1 GB
NE
Nemotron SEA LION v4.8 30B A3B Base
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
FU
functionary medium v3.1
Functionary · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
OH
Ohm MythosHeretic
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
GP
GPT4chan 24B
Gpt · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
OC
OceanGPT Basic 4B Instruct
Oceangpt · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
GE
Nexora Gemma 4 Coder
Gemma · guell00
Params7.52B
Context128K
Q4_K_M5.3 GB
GI
Gita SastraGPT V1
Gita · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
CO
cosmosage-v3
Cosmosage · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
microsoft/Phi-4-reasoning-vision-15B
Phi · dranger003
Params14.7B
Context32K
Smallest9.7 GB
RE
ReForm SFT 3B
Reform · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB