GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
LI
Ling 3.0 Flash Fin
Ling · bartowski
Params127B
Context256K
Q4_K_M77.8 GB
GP
Gpt2 Medium
Gpt · mradermacher
Params406M
Context1K
Q4_K_M0.3 GB
PH
Phi 3 Medium 4k Instruct
Phi · bartowski
Params14B
Context4K
Q4_K_M8.6 GB
OR
Ornith-1.5-35B
Ornith · peculiar-ragdoll
Params34.7B
Context256K
Smallest12.3 GB
MI
MiMo-V2.6-Flash-RL
Mimo · vultr
Params309B
Context1024K
Smallest2.4 GB
LI
Ling 3.0 flash abliterated APEX
Ling · SC117
Params127B
Context256K
Smallest60.4 GB
CY
Cyber Tiel Coder 35B A3B MTP TTQ
Cyber · TokenTinkerer
Params35.5B
Context256K
Q4_K_M21.6 GB
HU
Huihui Ornith 1.5 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
OR
Ornith 1.0 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
TE
tensor bank
Tensor · gguf-org
Params—
Context—
Q4_K_M0.0 GB
BG
Bge Small En v1.5
BGE · ggml-org
Params33M
Context512
Smallest0.0 GB
QW
UnifiedReward Edit Qwen35 27b
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
PH
Phi 3 mini 128k instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
Phi 3 Medium 128k Instruct
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · mmnga
Params3.36B
Context8K
Q4_K_M2.1 GB
PH
Phi 3 Medium 4k Instruct
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
OR
Ornith 1.5 35B A3B uncensored
Ornith · ressl
Params35.5B
Context256K
Q4_K_M21.7 GB
FR
FrogNano 4B 2609
Frognano · NANI-Nithin
Params4.33B
Context256K
Q4_K_M2.8 GB
WH
whisper large v3 turbo
Whisper · oxide-lab
Params809M
Context—
Smallest0.3 GB
GL
Glm-4.1V-9B-Thinking
GLM · unsloth
Params9.4B
Context64K
Q4_K_M6.2 GB
GU
GUI Owl 1.5 2B Instruct
Gui · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
PH
phi-4-mini-instruct
Phi · Mungert
Params3.84B
Context128K
Q4_K_M2.5 GB
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO
DeepSeek · AtomicChat
Params552B
Context1024K
Smallest120.7 GB
SA
SaulLM 54B Instruct i1
Saullm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
DE
DeepSeek V4.1 Flash 1017 FP8
DeepSeek · AMAImedia
Params748B
Context1024K
Q4_K_M444.7 GB
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params107B
Context1024K
Smallest103.4 GB
AP
cantina-security/apex-flash-1-abliterated
Apex · freakyskittle
Params320B
Context1024K
Q4_K_M193.4 GB
DE
DeepSeek R1 Qwen3 8B heretic
DeepSeek · saidutta69
Params8.19B
Context128K
Q4_K_M5.0 GB
MI
Mimo-Vl-7B-Rl
Mimo · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
HU
Huihui Ornith 1.5 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB