GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
CA
CantoneseLLM v2.0 30B A3B Thinking Chat Vector Merged
Cantonesellm · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
Reasoning
MI
midashenglm 0.6b
Midashenglm · mispeech
Params596M
Context40K
Q4_K_M0.4 GB
CodingVision
QW
Qwen3 VL 4B Instruct Abliterated v1
Qwen · prithivMLmods
Params4B
Context256K
Q4_K_M2.5 GB
Vision
MI
leolm_leo-mistral-hessianai-7b-chat
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BR
Breeze 7B 32k Instruct V1_0
Breeze · RichardErkhov
Params7.49B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen3.6-35B-A3B
Qwen · peculiar-ragdoll
Params34.7B
Context256K
Smallest13.7 GB
ReasoningVision
MO
Morpho 1.5B Distill
Morpho · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
OV
OvisOCR2
Ovisocr · bartowski
Params752M
Context256K
Q4_K_M0.6 GB
Vision
QW
Qwen3 0.6B TLDR Lora
Qwen · phh
Params1M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 32B Abliterated
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
NS
NSFW_13B_sft
Nsfw · mzwing
Params13.3B
Context4K
Q4_K_M8.6 GB
GGUF
QW
Qwen3 1.7b Abliterated
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
MI
mistral 7b orpo capybara reproduction
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
HY
Hy-Mt2-1.8B
unsloth
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
QW
Qwen3-Vl-8B-Instruct-1M
Qwen · unsloth
Params8.19B
Context977K
Q4_K_M5.0 GB
Vision
MI
Devstral Small 2507
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
LO
Loopl 0.8b
Loopl · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Tool useVision
MI
cognitivecomputations_dolphin-2.6-mistral-7b-dpo
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
RenCoder Ministral 8B Instruct 2410
Mistral · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
Coding
QW
Qwen3.6 27B uncensored abliterated i1 IQ4 XS GGUF Smaller
Qwen · lemonyins
Params27B
Context—
Smallest0.0 GB
GGUF
MI
ANITA NEXT 24B Magistral 2506 VISION ITA
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningVision
GE
GemmaTheWriter
Gemma · DavidAU
Params9.24B
Context8K
Q4_K_M5.8 GB
Roleplay
QW
Replete LLM V2.5 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen2.5 32B
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
QW
Qwen2.5 Coder 14B E2E Tests
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
PY
Pythia 1.4b Deduped
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
QE
qev 0.8b
Qev · labqoat
Params752M
Context256K
Smallest0.8 GB
Vision
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · ScottzillaSystems
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
QW
OpenChat 3.5 7B Qwen v2.0
Qwen · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
GO
Godoter
Godoter · Ruler97
Params27B
Context256K
Q4_K_M16.5 GB
Coding

Keep browsing