GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Qwen2.5 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
DMind-3-mini
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.5 GB
MI
MiMo Ornith 9B AGSI
Mimo · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
NE
NVIDIA-Nemotron-3.5-Bolt-E4B-DFlash
Nemotron · ggml-org
Params7.52B
Context128K
Smallest0.6 GB
LL
Llama Song Stream 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
TR
TranslatePsy AfriSLM 2B
Translatepsy · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
BI
BioMistral 7B
Biomistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
WH
Whittle Next 27B A3B
Whittle · logic65
Params27.6B
Context256K
Q4_K_M16.8 GB
OL
AMD OLMo 1B SFT DPO
OLMo · lmstudio-community
Params1.18B
Context2K
Q4_K_M0.7 GB
QW
Qwen3.5 9B
Qwen · Smoffyy
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 Jan v1 256k Ctx 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context256K
Q4_K_M3.6 GB
MI
Mistral 7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
JI
JiuZhou
Jiuzhou · mradermacher
Params7.5B
Context32K
Q4_K_M4.5 GB
QW
Qwopus3.8 27B Flash
Qwen · Jackrong
Params461M
Context256K
Q4_K_M16.8 GB
JE
JEV 27B VL
Jev · PALLER-NOVUS
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5 9B The Defiant Fable DARK ROAST Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 1.7B Coder Distilled SFT
Qwen · reaperdoesntknow
Params2.03B
Context40K
Q4_K_M1.3 GB
GR
granite 4.2 8b heretic
Granite · saidutta69
Params8.79B
Context128K
Q4_K_M5.3 GB
LL
Llama 3.2 uncensored erotica
Llama · hungng
Params3.21B
Context128K
Smallest6.4 GB
LF
LFM2.5 1.2B Nova Function Calling
Lfm · NovachronoAI
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Millie 1.1 35B A3B Ternary
Qwen · llmsforall
Params34.7B
Context—
Smallest0.3 GB
GE
Gemma 4 E4B It Uncensored
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
QW
Qwen3.5 14B A3B Claude 4.6 Opus Reasoning Distilled reap
Qwen · tvall43
Params14.1B
Context256K
Smallest8.8 GB
QW
Qwen3.6 27B PRISM PRO
Qwen · Ex0bit
Params27.3B
Context256K
Smallest13.7 GB
MU
Muse Glimmer 30B NVFP4
Muse · esatapedico
Params27.9B
Context128K
Smallest15.2 GB
FL
d3-flash Artemis 4.6GB
Flash · turintech
Params8.95B
Context256K
Smallest4.6 GB
QW
Qwen3.5 9b Triple Loop Fase2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB