GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
DE
DevilsAdvocate 8B
Devilsadvocate · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.8 Flash Next GGUF HALO
Qwen · Beinsezii
Params180B
Context256K
Smallest0.6 GB
AU
AutoGLM Phone 9B
Autoglm · mradermacher
Params9.4B
Context64K
Q4_K_M6.2 GB
QW
UnifiedReward 2.0 Qwen 32b
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
Deekseek R1 Qwen3 8b
Qwen · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
OR
Ornith 1.0 9B Heretic MTP
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
DE
DeepSeek V4 Flash 0731 Abliterated DS4 Quality128
DeepSeek · apetersson
Params284B
Context1024K
Smallest7.3 GB
QW
Majority Voting Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QO
QoQ Med VL 32B
Qoq · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
DE
DeepCoder-14B-Preview
DeepSeek · Mungert
Params14.8B
Context128K
Q4_K_M9.2 GB
GT
gte-small
Gte · ChristianAzinn
Params33M
Context512
Q4_K_M0.0 GB
CL
clipclap
Clipclap · antflydb
Params69M
Context—
Smallest0.0 GB
QW
UnifiedReward Edit Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DE
deepseek r1 14b
DeepSeek · PsiPi
Params14.8B
Context128K
Smallest9.0 GB
FI
fietje 2 instruct i1
Fietje · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
MI
Mixtral AI CyberBrain 3 0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
WE
WebGen LM 7B
Webgen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CY
Cydonia v1.3 Magnum V4 22B i1
Cydonia · BasedAGI
Params22.2B
Context32K
Q4_K_M13.3 GB
JO
JOSIE 2 9B OSS
Josie · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Anki Qwen 2.5
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GU
GUI Owl 1.5 8B Instruct
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
FA
Fara1.5 27B
Fara · prithivMLmods
Params26.9B
Context256K
Q4_K_M16.5 GB
AU
AURORAV0.3 4B
Aurorav · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
TE
TextLap COCO
Textlap · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
AN
M3.2 24B Animus V7.0
Animus · Darkhn-Quants
Params23.6B
Context128K
Q4_K_M14.3 GB
PA
PathFinder PRM 7B
Pathfinder · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored Reasoner
DeepSeek · jackklki990
Params7.61B
Context128K
Q4_K_M4.7 GB
LL
LLaMAX2-7B
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
NO
Nous-Capybara-3B-V1.9
Nous · afrideva
Params2.8B
Context4K
Q4_K_M1.7 GB
GL
THUDM/GLM-Z1-32B-0414
GLM · DevQuasar-13
Params32.6B
Context32K
Q4_K_M19.7 GB