GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
NO
CodeRankEmbed Q8 0
Nomic · brandtcormorant
Params137M
Context2K
Smallest0.1 GB
CodingEmbedding
LE
lens
Lens · gguf-org
Params4.1B
Context—
Smallest0.2 GB
GGUF
MI
models--MaziyarPanahi--zephyr-7b-beta-Mistral-7B-Instruct-v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OM
OmniDimen V1.5 14B Emotion
Omnidimen · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
Tool use
MI
StructLM 7B Mistral
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · second-state
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
QW
Deductive Reasoning Qwen 14B
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
QW
agentflow-planner-7b
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M5.0 GB
Tool use
CR
CroPond 7B
Cropond · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
GL
GLM 4.7 Flash Uncensored Heretic NEO CODE Imatrix MAX
GLM · servantofares
Params29.9B
Context198K
Q4_K_M18.5 GB
CodingReasoningRoleplay
OR
Ornith 1.0 35B A3B MXFP4 MOE Hybrid Imatrix
Ornith · jashepp
Params34.7B
Context256K
Smallest0.2 GB
GGUF
HA
Harrier Oss v1 0.6b
Harrier · SuperPauly
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
BG
bge large zh i1
BGE · mradermacher
Params324M
Context512
Q4_K_M0.2 GB
Embedding
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · mmnga
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
LU
Lumina-2.75M
Lumina · jacopof
Params3M
Context165
Smallest0.0 GB
Coding
GL
GLM Z1 32B 0414
GLM · mradermacher
Params32.6B
Context32K
Q4_K_M19.7 GB
Tool use
LI
Ling Lite
Ling · bartowski
Params16.8B
Context16K
Q4_K_M11.2 GB
GGUF
OR
Ornith 1.5 35B A3B NVFP4
Ornith · TizzyT566
Params35.5B
Context256K
Smallest23.9 GB
ReasoningTool useVision
AT
Atomight V2.2 0.5B UltraThink
Atomight · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
TR
Truthful DPO TomGrc FusionNet 7Bx2 MoE 13B
Truthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
LL
LightGPT 8B Llama3
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GL
GLM 4 T1 54B
GLM · mradermacher
Params54.2B
Context32K
Q4_K_M32.7 GB
ReasoningTool use
GR
Granite_42_30b_Abliterated
Granite · mradermacher
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
SW
SWE Star 14B
Swe · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
PH
Phi 4 Abliterated
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
QW
Qwen3 8B ERP v0.1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
OR
Ornith 1.5 397B uncensored
Ornith · Lethevimlet
Params403B
Context256K
Smallest235.2 GB
GGUF
FR
Lumen i1
Fresco · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
SP
SP 7B i1
mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
UL
UltraLM 13B v2.0
Ultralm · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing