GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
VI
Vistral 7B Chat
Vistral · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
GGUF
AP
Apriel 1.5 15b Thinker
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
ReasoningTool use
CH
MN Chthonia 12B i1
Chthonia · BasedAGI
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
PH
Phi Mini MoE
Phi · gabriellarson
Params7.65B
Context4K
Q4_K_M5.0 GB
GGUF
NE
Next 14b
Next · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
OR
Ornith 1.5 9B Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
OR
Ornith 1.5 35B A3B REAP 50
Ornith · Ttimms
Params18.5B
Context256K
Q4_K_M11.4 GB
GGUF
MI
MiMo VL 7B SFT 2508
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
KI
Qwopus3.5 122B A10B Kimi K2.6 Destill Healed Abliterated
Kimi · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
ReasoningTool useVision
HE
HelpingAI Lite
Helpingai · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
ME
MetaAligner HH RLHF 7B i1
Metaaligner · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
BL
Q3.5 BlueStar v2 27B Ultra Uncensored Heretic v1
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplayTool use
NE
Apriel Nemotron 15b Thinker Magic_decensored_MPOA
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
ReasoningTool use
GL
mango glm53flash bolding iq2xxs 20261029
GLM · isilicon
Params321B
Context1024K
Smallest97.1 GB
ReasoningTool use
BG
bge m3
BGE · bbvch-ai
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
NE
Nemotron SEA LION v4.8 30B A3B Base
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
GL
GLM 5.3 Flash
GLM · therickcain
Params321B
Context1024K
Smallest93.1 GB
ReasoningTool useVision
ST
StructLM-7B
Structlm · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · Riyan200324200324
Params32.8B
Context128K
Q4_K_M19.8 GB
Reasoning
DE
DeepSeek V4.1 Flash EXL3 3.0bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
GGUF
GL
cerebras/GLM-4.7-Flash-REAP-23B-A3B
GLM · mradermacher
Params23B
Context198K
Q4_K_M13.9 GB
ReasoningTool use
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
TO
ToolCUA 8B
Toolcua · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
Tool useVision
NE
Next 32b
Next · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ReasoningTool use
GL
GLM 4.1V 9B Thinking
GLM · mradermacher
Params9.4B
Context64K
Q4_K_M6.2 GB
Reasoning
OR
Ornith 1.5 9B
Ornith · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
DE
DeepSeek V4.1 Flash MXFP4
DeepSeek · kernelpool
Params485M
Context—
Smallest1.0 GB
GGUF
TI
TIGERScore 13B
Tigerscore · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
PH
Phi 4 mini instruct
Phi · AtomicChat
Params3.84B
Context128K
Q4_K_M2.5 GB
Tool use
NE
Nehuronion Dvt 9b
Nehuronion · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing