GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
VI
Vistral 7B Chat
Vistral · mradermacher
Params7.29B
Context32K
Q4_K_M4.4 GB
AP
Apriel 1.5 15b Thinker
Apriel · mradermacher
Params14.4B
Context256K
Q4_K_M8.8 GB
CH
MN Chthonia 12B i1
Chthonia · BasedAGI
Params12.2B
Context128K
Q4_K_M7.5 GB
PH
Phi Mini MoE
Phi · gabriellarson
Params7.65B
Context4K
Q4_K_M5.0 GB
NE
Next 14b
Next · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
OR
Ornith 1.5 9B Abliterated
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
OR
Ornith 1.5 35B A3B REAP 50
Ornith · Ttimms
Params18.5B
Context256K
Q4_K_M11.4 GB
MI
MiMo VL 7B SFT 2508
Mimo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
KI
Qwopus3.5 122B A10B Kimi K2.6 Destill Healed Abliterated
Kimi · mradermacher
Params125B
Context256K
Q4_K_M75.8 GB
HE
HelpingAI Lite
Helpingai · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
ME
MetaAligner HH RLHF 7B i1
Metaaligner · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
BL
Q3.5 BlueStar v2 27B Ultra Uncensored Heretic v1
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
NE
Apriel Nemotron 15b Thinker Magic_decensored_MPOA
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
GL
mango glm53flash bolding iq2xxs 20261029
GLM · isilicon
Params321B
Context1024K
Smallest97.1 GB
BG
bge m3
BGE · bbvch-ai
Params567M
Context8K
Q4_K_M0.4 GB
NE
Nemotron SEA LION v4.8 30B A3B Base
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
GL
GLM 5.3 Flash
GLM · therickcain
Params321B
Context1024K
Smallest93.1 GB
ST
StructLM-7B
Structlm · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · Riyan200324200324
Params32.8B
Context128K
Q4_K_M19.8 GB
DE
DeepSeek V4.1 Flash EXL3 3.0bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
GL
cerebras/GLM-4.7-Flash-REAP-23B-A3B
GLM · mradermacher
Params23B
Context198K
Q4_K_M13.9 GB
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
TO
ToolCUA 8B
Toolcua · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
NE
Next 32b
Next · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GL
GLM 4.1V 9B Thinking
GLM · mradermacher
Params9.4B
Context64K
Q4_K_M6.2 GB
OR
Ornith 1.5 9B
Ornith · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
DE
DeepSeek V4.1 Flash MXFP4
DeepSeek · kernelpool
Params485M
Context—
Smallest1.0 GB
TI
TIGERScore 13B
Tigerscore · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
PH
Phi 4 mini instruct
Phi · AtomicChat
Params3.84B
Context128K
Q4_K_M2.5 GB
NE
Nehuronion Dvt 9b
Nehuronion · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB