GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
QW
UnifiedReward Edit Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
BL
Q3.5 BlueStar v2 27B
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ST
STELLA VLM JoVE 7B
Stella · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · PrunaAI
Params10M
Context128K
Q4_K_M0.0 GB
SW
SWE Dev 32B
Swe · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
DMind-1-mini
Qwen · Mungert
Params14.8B
Context40K
Q4_K_M9.1 GB
MA
MAmmoTH2-8B-Plus
Mammoth · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
PA
PathFinder PRM 7B
Pathfinder · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
LZ
lzw1008 Emollama 7b
Lzw · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
AL
ALMA 7B
Alma · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GT
gte-large
Gte · gianni-cor
Params334M
Context512
Smallest0.7 GB
LI
Ling 3.0 Tiny
Ling · vincespeed
Params7.89B
Context128K
Smallest4.0 GB
TI
tiny1m
Tiny · shibatch
Params—
Context256
Q4_K_M0.0 GB
BI
bitnet b1 58 large TQ2 0
Bitnet · gianni-cor
Params729M
Context2K
Smallest0.2 GB
DE
DeepSeek-R1-Distill-Qwen-14B
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.0 GB
OR
Ornith 1.5 9B NVFP4 MTP
Ornith · tiyuvta
Params9B
Context—
Smallest0.0 GB
SV
SVGThinker 7B
Svgthinker · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek V4 Flash DSpark drafter
DeepSeek · bleysg
Params19.8B
Context—
Smallest6.9 GB
PH
Phi 4 Mini Instruct
Phi · second-state
Params3.84B
Context128K
Q4_K_M2.5 GB
GL
GLM 4 9B 0414
GLM · mradermacher
Params9.4B
Context32K
Q4_K_M6.2 GB
NE
Next 1b
Next · thelamapi
Params1B
Context32K
Smallest1.1 GB
DE
DeepKAT 32B
Deepkat · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
AU
AURA Eve Tactical Instruct 3.8B
Aura · mradermacher
Params3.84B
Context128K
Q4_K_M2.5 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · NonMiFrega
Params1.78B
Context128K
Q4_K_M1.1 GB
IC
Icarus 1 8b
Icarus · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
JI
JiRackUltra_14b
Jirackultra · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Llama 8B Debiased
DeepSeek · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
OR
Ornith 1.5 35B MaxQuality MTP
Ornith · offmonreal
Params35.5B
Context256K
Q4_K_M21.7 GB
OP
Openhands Lm 7b v0.1
Openhands · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
WM
wmt21 dense 24 wide en x
Wmt · cstr
Params4.7B
Context—
Smallest2.7 GB