GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
AG
Agents A1 APEX
Agents · mudler
Params34.7B
Context256K
Smallest13.5 GB
OL
ollama3.2 flutter
Ollama · pavansn2000
Params3.21B
Context128K
Smallest3.4 GB
GR
Granite 4.0 H Micro
Granite · ibm-granite
Params3.2B
Context1024K
Q4_K_M1.9 GB
QW
Qwen3.8 27B Abliterated GSQ Orca
Qwen · ayozhee
Params27.3B
Context256K
Smallest9.6 GB
QW
Qwen3.8 27B EfficientThink VAL APEX I NanoPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Q4_K_M1.1 GB
BE
Behemoth 128B v3
Behemoth · bartowski
Params125B
Context256K
Q4_K_M78.4 GB
QW
Qwen2.5.1 Coder 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
DA
dasiwaWAN22I2V14B
Dasiwawan · Bedovyy
Params14.3B
Context—
Q4_K_M9.7 GB
QW
Qwen3.8 27B APEX
Qwen · mudler
Params27.3B
Context256K
Smallest11.2 GB
DA
Dark Scarlett 27B v2.0
Dark · ReadyArt
Params27.3B
Context256K
Q4_K_M16.8 GB
AP
APUS Reflex 4B
Apus · apus-ailab
Params4.2B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.6 27B MTP pi tune
Qwen · bytkim
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3-Vl-8B-Thinking
Qwen · unsloth
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3 VL 2B Instruct
Qwen · bartowski
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.5 397B A17B
Qwen · bartowski
Params403B
Context256K
Q4_K_M248.3 GB
VE
Veloxy Titan 32B Vision
Veloxy · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ON
OneJev 9B
Onejev · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
PA
Pantheon Reasoning 26B A4B 1.1 V2
Pantheon · bartowski
Params26B
Context256K
Q4_K_M18.8 GB
QW
Qwen3 Reranker 0.6B GGUF llama cpp
Qwen · Voodisss
Params596M
Context40K
Q4_K_M0.4 GB
GR
GRM 2.6 Plus
Grm · morikomorizz
Params27B
Context256K
Q4_K_M16.5 GB
HU
Huihui4 8B A4B
Huihui · huihui-ai
Params8.1B
Context256K
Smallest5.4 GB
PR
Privacy Filter Multilingual
Privacy · LocalAI-io
Params1.4B
Context128K
Smallest1.6 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · unsloth
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen.Qwen3 VL Embedding 2B
Qwen · DevQuasar
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.8 27B OBLITERATED Mythos Class Agentic
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 Writers 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
FI
FireRed Image Edit 1.1
Firered · vantagewithai
Params20.4B
Context—
Q4_K_M13.1 GB
CY
CyberSecQwen 4B
Cybersecqwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
QW
Qwen3.6 35B A3B APEX MTP
Qwen · mudler
Params35.5B
Context256K
Smallest11.7 GB
AR
AREX 2
Arex · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB