GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
DMind-3-mini
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.5 GB
Reasoning
MI
MiMo Ornith 9B AGSI
Mimo · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
ReasoningTool use
NE
NVIDIA-Nemotron-3.5-Bolt-E4B-DFlash
Nemotron · ggml-org
Params7.52B
Context128K
Smallest0.6 GB
ReasoningTool use
LL
Llama Song Stream 3B Instruct
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
TR
TranslatePsy AfriSLM 2B
Translatepsy · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
ReasoningTool use
BI
BioMistral 7B
Biomistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WH
Whittle Next 27B A3B
Whittle · logic65
Params27.6B
Context256K
Q4_K_M16.8 GB
CodingEmbeddingReasoning
OL
AMD OLMo 1B SFT DPO
OLMo · lmstudio-community
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Qwen3.5 9B
Qwen · Smoffyy
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen3 Jan v1 256k Ctx 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context256K
Q4_K_M3.6 GB
Coding
MI
Mistral 7B v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
JI
JiuZhou
Jiuzhou · mradermacher
Params7.5B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwopus3.8 27B Flash
Qwen · Jackrong
Params461M
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
JE
JEV 27B VL
Jev · PALLER-NOVUS
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen3.5 9B The Defiant Fable DARK ROAST Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningRoleplay
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3 1.7B Coder Distilled SFT
Qwen · reaperdoesntknow
Params2.03B
Context40K
Q4_K_M1.3 GB
CodingReasoningTool use
GR
granite 4.2 8b heretic
Granite · saidutta69
Params8.79B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
LL
Llama 3.2 uncensored erotica
Llama · hungng
Params3.21B
Context128K
Smallest6.4 GB
GGUF
LF
LFM2.5 1.2B Nova Function Calling
Lfm · NovachronoAI
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
QW
Millie 1.1 35B A3B Ternary
Qwen · llmsforall
Params34.7B
Context—
Smallest0.3 GB
GGUF
GE
Gemma 4 E4B It Uncensored
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
QW
Qwen3.5 14B A3B Claude 4.6 Opus Reasoning Distilled reap
Qwen · tvall43
Params14.1B
Context256K
Smallest8.8 GB
ReasoningVision
QW
Qwen3.6 27B PRISM PRO
Qwen · Ex0bit
Params27.3B
Context256K
Smallest13.7 GB
GGUF
MU
Muse Glimmer 30B NVFP4
Muse · esatapedico
Params27.9B
Context128K
Smallest15.2 GB
Vision
FL
d3-flash Artemis 4.6GB
Flash · turintech
Params8.95B
Context256K
Smallest4.6 GB
ReasoningTool use
QW
Qwen3.5 9b Triple Loop Fase2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF

Keep browsing