GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
JA
Janus Pro 7B LM
Janus · mradermacher
Params6.91B
Context16K
Q4_K_M4.2 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · AcerTest359
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
NE
Nexus IKM RolePlay StoryWriter Hermes 2 Pro 7B
Nexus · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayTool use
LL
Karma Electric R1Distill Llama 8b
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
OR
Ornith 1.5 35B A3B UNCENSORED
Ornith · therickcain
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
DE
DeepSWE Preview
Deepswe · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
HO
Holland 4B V1 i1
Holland · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
MI
mistral orpo capybara 7k
Mistral · tinyopsec
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
Microsoft Fara 7B
Fara · batiai
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
GP
Model Openai Community Gpt2 Xl Cache
Gpt · Alcoft
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · esc4late
Params29.9B
Context198K
Q4_K_M18.5 GB
CodingReasoningRoleplay
UN
unlimited ocr 2 ru
Unlimited · p4ulbr4dl3y
Params2.94B
Context128K
Q4_K_M2.1 GB
GGUF
GL
GLM Z1 9B 0414
GLM · mradermacher
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
MI
Mistral 7B v0.1 Flashback v2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek R1 Qwen3 8B Abliterated
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen3-4B-DFlash-b16
Qwen · Anbeeld
Params537M
Context40K
Q4_K_M0.3 GB
CodingEmbeddingReasoning
PH
phi2 haiku ita v0.2 i1
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
SY
SynLogic Mix 3 32B
Synlogic · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
SE
Seed Coder 8B Reasoning
Seed · mradermacher
Params8.25B
Context64K
Q4_K_M5.1 GB
CodingReasoning
QW
Qwen 7B toolcalling ReSearch gguf Q8 0 codex
Qwen · Manojb
Params7.62B
Context128K
Smallest8.1 GB
CodingTool use
NE
Nemotron SEA LION v4.8 30B A3B Base
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
FU
functionary medium v3.1
Functionary · gaianet
Params70.6B
Context128K
Q4_K_M42.5 GB
CodingTool use
OH
Ohm MythosHeretic
Ohm · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoningTool use
GP
GPT4chan 24B
Gpt · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
OC
OceanGPT Basic 4B Instruct
Oceangpt · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
GE
Nexora Gemma 4 Coder
Gemma · guell00
Params7.52B
Context128K
Q4_K_M5.3 GB
CodingReasoningTool use
GI
Gita SastraGPT V1
Gita · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
CO
cosmosage-v3
Cosmosage · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
PH
microsoft/Phi-4-reasoning-vision-15B
Phi · dranger003
Params14.7B
Context32K
Smallest9.7 GB
ReasoningVision
RE
ReForm SFT 3B
Reform · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
CodingTool use

Keep browsing