GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
JE
Jev-Style-2B-Decision-v3
Jev · chaoliangUNSW
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
MI
Ministral 3 3B Reasoning 2512
Mistral · mistralai
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
DI
discoresearch_discolm_german_7b_v1
Discolm · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CL
Clef Artemis
Clef · turintech
Params27B
Context256K
Smallest10.5 GB
ReasoningTool use
QW
Qwen2.5 14B Instruct
Qwen · TheRains
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
OR
Ornith 1.5 122B DFlash2
Ornith · kaivoss
Params930M
Context256K
Q4_K_M0.6 GB
GGUF
ST
G4 Starry Ocean 12B Heretic
Starry · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
QW
Qwen3.5 27B Writer V2 Uncensored Heretic
Qwen · llmfan46
Params27B
Context256K
Q4_K_M16.5 GB
Vision
QW
Qwen Image 2512
Qwen · byteshape
Params20.4B
Context—
Q4_K_M11.4 GB
GGUF
QW
Qwen3Vl 4b Thinking
Qwen · Qwen
Params4B
Context256K
Q4_K_M2.5 GB
ReasoningVision
IN
InternVL3_5 14B
Internvl · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
Vision
SA
SauerkrautLM 7b LaserChat
Sauerkrautlm · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 Vl 4b Heretic
Qwen · DreamFast
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Qwen3.8 27B Uncensored Heretic Native MTP Preserved NVFP4
Qwen · llmfan46
Params27.3B
Context256K
Smallest16.9 GB
Vision
OC
occamy 1.0 APEX
Occamy · Accio-Lab
Params34.7B
Context256K
Smallest13.5 GB
Tool useVision
LI
LightOnOCR 3 0.8B
Lightonocr · Prathat
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Huihui Qwen3.8 27B Abliterated
Qwen · IsValorum
Params27.3B
Context256K
Smallest14.2 GB
ReasoningVision
QW
Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · DavidAU
Params1.24B
Context128K
Q4_K_M0.8 GB
Roleplay
QW
Qwen3.5 4B Heretic
Qwen · Biomanticus
Params4.21B
Context256K
Smallest2.7 GB
GGUF
QW
Qwenmodel1st
Qwen · atypical-chai
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
CH
ChemLLM 20B Chat SFT i1
Chemllm · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
GGUF
QW
Qwen3Vl 30b A3B Thinking
Qwen · Qwen
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningVision
QW
Huihui ai.Qwen3 8B Abliterated
Qwen · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
LI
LightOnOCR 3 0.8B
Lightonocr · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen3.8-27B
Qwen · Kaktus4048
Params27.3B
Context256K
Q4_K_M16.6 GB
Vision
WA
Wan2.1 T2V 14B FusionX
Wan · QuantStack
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
OC
Occamy 1.0
Occamy · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
Tool useVision
QW
Bella Bartender Qwen3.5 2b
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
SM
SmolLM 1.7B
SmolLM · bartowski
Params1.71B
Context2K
Q4_K_M1.1 GB
Tool use

Keep browsing