GGUF models: mit license

17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.

Most downloadedNewestLargestLongest contextSmallest
WH
whisper vad encdec asmr
Whisper · cstr
Params30M
Context—
Smallest0.0 GB
GGUF
JO
JOSIE 4B Instruct
Josie · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
QW
Wildguard Qwen3 4b
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
QW
Tiel Coder 35B A3B Genesis Hermes NVFP4
Qwen · jan1k
Params34.7B
Context256K
Smallest21.5 GB
CodingReasoningTool use
QW
UnifiedReward Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
FU
functionary small v3.2
Functionary · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
CodingTool use
SA
Saul 7B Base
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SE
SeverusWestLake 7B DPO
Severuswestlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B BE
DeepSeek · taronaeo
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
PH
Phi 4 o1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
CodingReasoning
PH
Luminis phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
GGUF
MO
E Model V1
Model · mradermacher
Params7.4B
Context32K
Q4_K_M4.5 GB
Reasoning
MI
Midm 2.0 Mini Thinking
Midm · mradermacher
Params2.54B
Context32K
Q4_K_M1.6 GB
ReasoningTool use
TR
trojblue gpt2 prompt upscaler v1
Trojblue · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
GGUF
BG
bge m3 Q8A64
BGE · VelociQ8
Params865M
Context8K
Smallest0.9 GB
GGUF
OR
Ornith 1.5 35B A3B Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool use
PI
piccolo math 2x7b i1
Piccolo · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
XiaomiMiMo.MiMo V2.5 Pro
Mimo · DevQuasar
Params1020B
Context1024K
Q4_K_M619.2 GB
ReasoningTool use
ET
ethzanalytics ai msgbot gpt2 XL dialogue
Ethzanalytics · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
RI
Rio 3.0 Open Search
Rio · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017 GSQ RCO DSPARK
DeepSeek · neuralll
Params748B
Context1024K
Smallest4.9 GB
GGUF
GP
Gpt2_Pycode
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
Coding
PH
Phi 3 Mini 128k Instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
OR
Ornith 1.5 9B MTP NVFP4 newhead
Ornith · Cobra91310
Params9.2B
Context256K
Smallest6.5 GB
ReasoningTool use
MI
MiMo VL 7B SFT 2508
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
GU
GUI Owl 32B
Gui · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
LI
Lingshu 7B
Lingshu · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ReasoningTool use
MO
Monet 7B
Monet · mradermacher
Params7.61B
Context125K
Q4_K_M4.7 GB
Vision
PH
Phi 3 medium 128k instruct iMat
Phi · qwp4w3hyb
Params14B
Context128K
Q4_K_M8.6 GB
Coding
MI
MiMo V2.6 Flash MOPD Strix Halo
Mimo · gszj2018
Params309B
Context1024K
Smallest95.6 GB
ReasoningTool useVision

Keep browsing