GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3b Code Base 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
GP
Huihui gpt oss 20b abliterated v2 MXFP4 MOE
gpt-oss · noctrex
Params20.9B
Context128K
Smallest12.1 GB
Tool use
NY
Nyakura CausalLM RP 34B i1
Nyakura · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
Roleplay
QW
Qwen3.8 27B TQ
Qwen · YTan2000
Params27.3B
Context256K
Smallest0.8 GB
GGUF
TA
UI TARS 7B DPO
Tars · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
ME
q-bert_metamath-cybertron-starling
Metamath · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FL
Sakura FLUX.3 Image Klein PromptUpsampler Uncensored
Flux · webmp3
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
HO
Holo4 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.5 4B
Qwen · dahara1
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
GE
Gemma 4 12B It Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
MI
ANITA NEXT 24B Dolphin Mistral UNCENSORED ITA
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
Reasoning
DI
digital socrates 7b i1
Digital · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AU
Aura Prototype 26B A4B
Aura · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
SM
SmolLM 135M
SmolLM · QuantFactory
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
DE
DAN L3 R1 8B
DeepSeek · UnfilteredAI
Params8B
Context128K
Smallest16.1 GB
Reasoning
PE
PentaCoder 9B
Pentacoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoning
GE
Gemopus 4 26B A4B it Preview APEX
Gemopus · mudler
Params25.2B
Context256K
Smallest13.0 GB
GGUF
QW
QwenPaw Flash 9B heretic MTP
Qwen · SC117
Params456M
Context256K
Q4_K_M5.8 GB
Tool useVision
GE
Gemma 4 E2B It Uncensored MAX
Gemma · prithivMLmods
Params4.65B
Context128K
Smallest5.0 GB
ReasoningVision
GR
Granite 20b Code Instruct
Granite · legraphista
Params20B
Context8K
Smallest4.5 GB
CodingTool use
QW
security 8b
Qwen · bebrws
Params8.2B
Context128K
Q4_K_M5.0 GB
Tool use
GR
Granite 8b Code Base 128k
Granite · RichardErkhov
Params8.05B
Context125K
Q4_K_M4.9 GB
Coding
WA
Wan Move 14B 480P
Wan · vantagewithai
Params16.4B
Context—
Q4_K_M11.3 GB
GGUF
EA
EAN 8B i1
Ean · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool use
GE
DiarizationLM Gemma 4 E4B v1
Gemma · diarizers-community
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision
QW
Huihui Qwen3.5 27B Abliterated
Qwen · HeYujie
Params27B
Context256K
Q4_K_M16.5 GB
Vision
MI
MiniCPM5 1B Claude Opus Fable5 V2 Thinking heretic
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningRoleplayTool use
QW
Qwen3.5 122B A10B Heretic v2
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
GE
Huihui Gemma 4 E2B It Abliterated
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
QW
Qwen2.5 Coder 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding

Keep browsing