GGUF models: mit license
17492 GGUF models listed under the mit license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 5632B parameters. The longest trained context is 97656K tokens.
QW
UnifiedReward Think Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
TH
Thyme RL
Thyme · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OR
Ornith 1.5 35B A3B
Ornith · el4
Params35.5B
Context256K
Smallest12.1 GB
DI
Dirty-Alice
Dirty · mradermacher
Params464M
Context4K
Q4_K_M0.3 GB
QW
Entropy Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
FU
FusionNet
Fusionnet · RichardErkhov
Params21.2B
Context4K
Q4_K_M12.7 GB
DE
DeepSeek R1 Distill Qwen 14B Uncensored Reasoner
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
PH
Phi Delthanar i1
Phi · mradermacher
Params7.81B
Context2K
Q4_K_M4.8 GB
AX
Axon26 Coder
Axon · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
LE
Lens Turbo GGUF ComfyUI
Lens · vantagewithai
Params4.1B
Context—
Q4_K_M2.5 GB
UN
Unlimited OCR 2
Unlimited · cicaba
Params2.94B
Context128K
Q4_K_M2.0 GB
LL
cais HarmBench Llama 2 13b cls multimodal behaviors
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
PU
PulseMind 72B
Pulsemind · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
QW
Nexora Qwen Coder 4B
Qwen · guell00
Params4.33B
Context256K
Q4_K_M2.8 GB
PH
Phi 3.5 Mini 3.8B ArliAI RPMax v1.1
Phi · mradermacher
Params3.82B
Context128K
Q4_K_M2.4 GB
PH
phi 4
Phi · gaianet
Params14.7B
Context16K
Q4_K_M9.1 GB
RE
RealSafe R1 7B
Realsafe · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GL
GLM 4.5 Air
GLM · lmstudio-community
Params110B
Context128K
Q4_K_M73.5 GB
DE
deepseek v41 flash 1017 abliterated gguf public
DeepSeek · ktobik
Params748B
Context1024K
Smallest1.6 GB
OM
OmniDimen 2 8B Emotion Absolute Heresy
Omnidimen · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
DR
DRIFT VL 7B
Drift · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
SH
shisa v2.1 unphi4 14b i1
Shisa · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
QW
UnifiedReward Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · brittlewis12
Params8.19B
Context128K
Q4_K_M5.0 GB
LL
Cakrawala 70B i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LO
M3.2 24B Loki V1.3
Loki · CrucibleLab-TG
Params23.6B
Context128K
Q4_K_M14.3 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · tinyopsec
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Huihui Qwen3 30B A3B Abliterated Fusion 5050
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
OP
All Hands.Openhands Lm 32b v0.1
Openhands · DevQuasar-12
Params32.8B
Context32K
Q4_K_M19.9 GB
GL
GLM 4.7 Flash Impotent Heresy
GLM · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB