GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
jphme_em_german_leo_mistral
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
ComfyUI Qwen3 VL
Qwen · Abiray
Params8.77B
Context256K
Q4_K_M2.5 GB
Tool useVision
OP
openchat_openchat-3.5-0106
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MU
Muse Glimmer 30B pruned V2.5 en pl
Muse · bluevoid-pl
Params27B
Context128K
Q4_K_M16.3 GB
ReasoningTool useVision
MI
chronos mistral 7b i1
Mistral · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
GGUF
QW
Qwen3.8 Whittle 16B
Qwen · logic65
Params16.3B
Context256K
Q4_K_M10.1 GB
GGUF
JA
AI21 Jamba Reasoning 3B
Jamba · bartowski
Params3.2B
Context256K
Q4_K_M1.9 GB
Reasoning
SA
Salience 27B R5
Salience · bartowski
Params27.3B
Context1024K
Q4_K_M17.8 GB
CodingReasoningTool use
NE
NeuralMona MoE 4x7B i1
Neuralmona · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
GGUF
QW
Huihui Qwen3.5 122B A10B Abliterated
Qwen · huihui-ai
Params122B
Context256K
Smallest74.2 GB
Vision
KA
KAI 7B Instruct v0.1
Kai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
SA
Strata Sage A1.5
Sage · ykarout
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool use
JE
Jeffan 31b 1710
Jeffan · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
ReasoningTool useVision
PS
Psyonic-Cetacean-full-precision
Psyonic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
TE
Ternary Bonsai 2 27B Abliterated swift cap PQ2 0 MTP
Ternary · hotdogs
Params27.3B
Context256K
Smallest7.6 GB
ReasoningVision
VE
Veritas 8B Fact Checker Non Thinking 1.0
Veritas · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
LL
model
Llama · ChatGpt1
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · CISCai
Params7.62B
Context32K
Smallest1.9 GB
Coding
HU
HumanlikeRP
Humanlikerp · mradermacher
Params8.83B
Context12K
Q4_K_M5.3 GB
GGUF
NE
Nex N2.5 Mini
Nex · IsValorum
Params34.7B
Context256K
Smallest14.8 GB
ReasoningTool useVision
QW
Qwen3.5 4B EmperoAI Qwen3.8 Distill Heretic Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
MI
paixai_astrid-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.5 4B DFlash
Qwen · magnitudedev
Params634M
Context40K
Smallest0.7 GB
GGUF
TI
Tifa Deepsex 14b CoT GGUF Q4
Tifa · ValueFX9507
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
MI
Ministral-3-3B-Reasoning-2512
Mistral · Mungert
Params3.43B
Context256K
Q4_K_M2.2 GB
Reasoning
QW
Agrillm Qwen3 30B A3B
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
QW
Qwen2.5 VL 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
CodingVision
SM
KrynexAI 1.4
SmolLM · KrynexLabs
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
NA
Nanbeige4.3 33B Base
Nanbeige · nesymerp1
Params33.1B
Context128K
Q4_K_M20.1 GB
GGUF

Keep browsing