GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
WH
whisper vad encdec asmr
Whisper · cstr
Params30M
Context—
Smallest0.0 GB
JO
JOSIE 4B Instruct
Josie · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Wildguard Qwen3 4b
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Tiel Coder 35B A3B Genesis Hermes NVFP4
Qwen · jan1k
Params34.7B
Context256K
Smallest21.5 GB
QW
UnifiedReward Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
FU
functionary small v3.2
Functionary · gaianet
Params8.03B
Context128K
Q4_K_M4.9 GB
SA
Saul 7B Base
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SE
SeverusWestLake 7B DPO
Severuswestlake · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek R1 0528 Qwen3 8B BE
DeepSeek · taronaeo
Params8.19B
Context128K
Q4_K_M5.0 GB
PH
Phi 4 o1
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
PH
Luminis phi 4
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
MO
E Model V1
Model · mradermacher
Params7.4B
Context32K
Q4_K_M4.5 GB
MI
Midm 2.0 Mini Thinking
Midm · mradermacher
Params2.54B
Context32K
Q4_K_M1.6 GB
TR
trojblue gpt2 prompt upscaler v1
Trojblue · RichardErkhov
Params406M
Context1K
Q4_K_M0.3 GB
BG
bge m3 Q8A64
BGE · VelociQ8
Params865M
Context8K
Smallest0.9 GB
OR
Ornith 1.5 35B A3B Abliterated
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
PI
piccolo math 2x7b i1
Piccolo · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
MI
XiaomiMiMo.MiMo V2.5 Pro
Mimo · DevQuasar
Params1020B
Context1024K
Q4_K_M619.2 GB
ET
ethzanalytics ai msgbot gpt2 XL dialogue
Ethzanalytics · RichardErkhov
Params1.64B
Context1K
Q4_K_M1.2 GB
RI
Rio 3.0 Open Search
Rio · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
DE
DeepSeek V4.1 Flash 1017 GSQ RCO DSPARK
DeepSeek · neuralll
Params748B
Context1024K
Smallest4.9 GB
GP
Gpt2_Pycode
Gpt · mradermacher
Params124M
Context1K
Q4_K_M0.1 GB
PH
Phi 3 Mini 128k Instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
OR
Ornith 1.5 9B MTP NVFP4 newhead
Ornith · Cobra91310
Params9.2B
Context256K
Smallest6.5 GB
MI
MiMo VL 7B SFT 2508
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GU
GUI Owl 32B
Gui · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
LI
Lingshu 7B
Lingshu · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
MO
Monet 7B
Monet · mradermacher
Params7.61B
Context125K
Q4_K_M4.7 GB
PH
Phi 3 medium 128k instruct iMat
Phi · qwp4w3hyb
Params14B
Context128K
Q4_K_M8.6 GB
MI
MiMo V2.6 Flash MOPD Strix Halo
Mimo · gszj2018
Params309B
Context1024K
Smallest95.6 GB