GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
AG
Agents A1 APEX
Agents · mudler
Params34.7B
Context256K
Smallest13.5 GB
Vision
OL
ollama3.2 flutter
Ollama · pavansn2000
Params3.21B
Context128K
Smallest3.4 GB
GGUF
GR
Granite 4.0 H Micro
Granite · ibm-granite
Params3.2B
Context1024K
Q4_K_M1.9 GB
GGUF
QW
Qwen3.8 27B Abliterated GSQ Orca
Qwen · ayozhee
Params27.3B
Context256K
Smallest9.6 GB
GGUF
QW
Qwen3.8 27B EfficientThink VAL APEX I NanoPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
BE
Behemoth 128B v3
Behemoth · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
GGUF
QW
Qwen2.5.1 Coder 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
DA
dasiwaWAN22I2V14B
Dasiwawan · Bedovyy
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
QW
Qwen3.8 27B APEX
Qwen · mudler
Params27.3B
Context256K
Smallest11.2 GB
Vision
DA
Dark Scarlett 27B v2.0
Dark · ReadyArt
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayVision
AP
APUS Reflex 4B
Apus · apus-ailab
Params4.2B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Qwen3.6 27B MTP pi tune
Qwen · bytkim
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
QW
Qwen3-Vl-8B-Thinking
Qwen · unsloth
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningVision
QW
Qwen3 VL 2B Instruct
Qwen · bartowski
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
QW
Qwen3.5 397B A17B
Qwen · bartowski
Params403B
Context256K
Q4_K_M248.3 GB
Vision
VE
Veloxy Titan 32B Vision
Veloxy · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningVision
ON
OneJev 9B
Onejev · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
Vision
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · bartowski
Params26B
Context256K
Q4_K_M18.8 GB
ReasoningRoleplay
QW
Qwen3 Reranker 0.6B GGUF llama cpp
Qwen · Voodisss
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
GR
GRM 2.6 Plus
Grm · morikomorizz
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
HU
Huihui4 8B A4B
Huihui · huihui-ai
Params8.1B
Context256K
Smallest5.4 GB
Vision
PR
Privacy Filter Multilingual
Privacy · LocalAI-io
Params1.4B
Context128K
Smallest1.6 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · unsloth
Params7.62B
Context128K
Q4_K_M4.7 GB
Coding
QW
Qwen.Qwen3 VL Embedding 2B
Qwen · DevQuasar
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingVision
QW
Qwen3.8 27B OBLITERATED Mythos Class Agentic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GE
Gemma 4 Writers 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
FI
FireRed Image Edit 1.1
Firered · vantagewithai
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
CY
CyberSecQwen 4B
Cybersecqwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.6 35B A3B APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
GGUF
AR
AREX 2
Arex · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision

Keep browsing