GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
BE
Bernini R GGUF ComfyUI
Bernini · vantagewithai
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
DA
Dans PersonalityEngine V1.1.0 12b
Dans · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
CodingRoleplay
KR
Kronumos Kairos v2
Kronumos · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
Coding
SE
SexyGPT v3 Thinking Female
Sexygpt · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayVision
PS
Psyonic Cetacean Ultra Quality 20b GGUF imatrix
Psyonic · DavidAU
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
CA
Carnice V3
Carnice · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
Tool useVision
ME
Meltemi 7B Instruct v1
Meltemi · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen3.8-Flash-Next-DFlash2
Qwen · incoai
Params603M
Context256K
Q4_K_M0.4 GB
ReasoningTool use
CL
clef flash
Clef · NANI-Nithin
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
MO
Morpho 7B Distill
Morpho · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
SM
Smaug Humanizer
Smaug · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
QW
Qwen3.8 27B Uncensored
Qwen · prakharprasad
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
RE
ReflectionCoder-DS-6.7B
Reflectioncoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
SA
Sage A1.5 Q6 K
Sage · InternScience
Params35.5B
Context256K
Smallest29.2 GB
CodingReasoningTool use
FI
v6 Finch 7B HF
Finch · bartowski
Params7.64B
Context1024K
Q4_K_M4.8 GB
GGUF
QW
Qwen3.6 27B Abliterated Heretic Uncensored BF16 v4
Qwen · Youssofal
Params27B
Context256K
Q4_K_M16.5 GB
Vision
GE
Gemma 4 Dark Thoughts V2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
MI
Ministral 3 3B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
QW
Qwen2.5 Coder 3B Instruct
Qwen · unsloth
Params3.09B
Context128K
Q4_K_M1.9 GB
Coding
QW
Qwen2.5 14B Instruct
Qwen · ThomasBaruzier
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
WH
Whisper Base (English)
Whisper · handy-computer
Params73M
Context—
Q4_K_M0.1 GB
GGUF
YI
CursorCore Yi 9B i1
Yi · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
QW
Qwen3.8 27B Heretic Uncensored Q4 K M
Qwen · mlasli
Params27.3B
Context256K
Q4_K_M17.0 GB
Roleplay
GR
Grug 27b
Grug · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
ReasoningTool useVision
OL
OLMo 7B 0424 Hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GGUF
GR
Granite 3b Code Instruct
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
OR
Ornith 1.5 9B Uncensored
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
MI
Mahou-1.3c-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2-1.5B
Qwen · legraphista
Params1.54B
Context128K
Smallest0.4 GB
GGUF
D3
d3
mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision

Keep browsing