GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
Gpt Oss 20b Unsloth Puzzle V2
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Reasoning
TR
TranslatePsy AfriSLM 4B
Translatepsy · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ReasoningTool use
MI
lemonilia_ashhlimarp-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ON
OneJev 0.8B
Onejev · bartowski
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
HO
K2 Horizon MoVA 36B A4B
Horizon · ngquocvinh
Params37.4B
Context512K
Q4_K_M22.4 GB
GGUF
AI
aixsatoshi Ex karakuri 8x12B chat v1
Aixsatoshi · mmnga
Params81.5B
Context32K
Smallest17.1 GB
GGUF
ME
models--automerger--T3qm7Mergerix-7B
Mergerix · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
models--automerger--Experiment28Yam-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EV
EAN 7B i1
Evan · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Reasoning
QW
OpenBuddy OpenBuddy R1 0528 Distill Qwen3 32B Preview0 QAT
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
Reasoning
QW
Trohrbaugh Qwen3.5 122B A10B Heretic
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningTool use
QW
Qwen3-4B-128K
Qwen · unsloth
Params4B
Context128K
Q4_K_M2.5 GB
GGUF
TI
Tiamat-7b-1.1-DPO
Tiamat · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.8 Flash Coder APEX I NanoPlus
Qwen · IsValorum
Params42.6B
Context256K
Smallest18.3 GB
CodingReasoningTool use
RO
ROMA 7B
Roma · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GE
Gemma 4 31B It Mystery Fine Tune HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingReasoningRoleplay
GR
GRM 2.6 Plus 0628
Grm · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
Vision
SM
SmolVLM Instruct
Smolvlm · ggml-org
Params1.81B
Context16K
Q4_K_M1.1 GB
Vision
KA
KAI 7B v0.1
Kai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LL
Chinese Llama 2 13B
Llama · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
MO
Mox Small 1
Mox · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
HU
Huihui Agents A1 Abliterated
Huihui · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
OX
OxCoder 9B
Oxcoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingVision
QW
Qwen3.8 9B Heretic Uncensored
Qwen · optionalAI
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
HO
Holo 3.1 9B
Holo · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Remnant Qwen3 8b
Qwen · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
Roleplay
QW
Qwen3 235B A22B Abliterated
Qwen · mradermacher
Params235B
Context40K
Q4_K_M142.2 GB
GGUF
SA
Sage A1.5 APEX I NanoPlus V2.1
Sage · IsValorum
Params35.5B
Context256K
Smallest13.0 GB
ReasoningTool useVision
HE
L3.1 RP Hero Dirty Harry 8B
Hero · DavidAU
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
MO
moss tts v1.5
Moss · cstr
Params1.77B
Context—
Smallest3.5 GB
GGUF

Keep browsing