GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
XI
Xing4.0 29B A4B
Xing · XingChen-AGI
Params31.2B
Context256K
Smallest0.2 GB
GGUF
XX
encoder
Xxl · chatpig
Params219M
Context512
Q4_K_M2.9 GB
Coding
ME
G4 MeroMero 26B A4B It Uncensored Heretic
Meromero · llmfan46
Params25.2B
Context256K
Q4_K_M17.3 GB
RoleplayVision
LY
Lythri 4B A2B
Lythri · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
GGUF
MI
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated
Mistral · maerong3
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
QW
Qwen3.5 35B A3B APEX
Qwen · mudler
Params34.7B
Context256K
Smallest13.3 GB
Vision
NE
NeoHorse-1-4B
Neohorse · TokenRhythm
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
DE
WhiteRabbitNeo WhiteRabbitNeo V3 7B
Deephat · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
CE
mispeech/ced-tiny
Ced · mudler
Params86M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 32B Uncensored
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen3 VL 8B Heretic Stable
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
LL
Llama 3.2 8X4B MOE V2 Dark Champion Instruct uncensored abliterated 21B
Llama · DavidAU
Params20.9B
Context128K
Q4_K_M12.9 GB
Roleplay
GR
Granite 20b Code Instruct
Granite · bartowski
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
HO
Holo4 35B A3B
Holo · Hcompany
Params34.7B
Context256K
Q4_K_M21.3 GB
Vision
SA
Sabi Noema
Sabi · owao
Params27B
Context256K
Q4_K_M16.5 GB
Tool useVision
QW
qwen2.5-32b-instruct
Qwen · Qwen
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
HO
K2-Horizon-MoVA-36B-A4B
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
GGUF
QW
Qwen3 8B Heretic
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes Final NVFP4
Qwen · jan1k
Params34.7B
Context256K
Smallest21.1 GB
Tool useVision
QW
Qwen3.5 9B Coder
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use
MI
Mistral Small 3.1 24B Instruct 2503
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
FU
Fun ASR Nano
Fun · FunAudioLLM
Params234M
Context—
Smallest0.5 GB
GGUF
MI
MiniCPM5 2B Math
MiniCPM · Caldalis
Params2.52B
Context128K
Q4_K_M1.6 GB
Reasoning
QW
Qwen3.6 35B Uncensored HauhauCS 1M
Qwen · satgeze
Params447M
Context1024K
Q4_K_M21.7 GB
Vision
MI
Ministral-3-14B-Reasoning-2512
Mistral · unsloth
Params13.5B
Context256K
Q4_K_M8.2 GB
ReasoningVision
FL
FLUX.2 klein base 4B
Flux · leejet
Params3.88B
Context—
Smallest2.5 GB
GGUF
MA
UI Mate 9B
Mate · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
QW
Qwen3-Coder-480B-A35B-Instruct
Qwen · unsloth
Params480B
Context256K
Q4_K_M290.1 GB
Coding
QW
Qwen3.8-27B
Qwen · julianmb
Params27.3B
Context256K
Smallest9.2 GB
GGUF
TE
Ternary Bonsai 2 27B Abliterated PQ2 0 MTP
Ternary · BoldingBuilds
Params27B
Context256K
Smallest7.2 GB
GGUF

Keep browsing