GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
MI
Minicpm
MiniCPM · trithemius
Params34.7B
Context256K
Smallest15.5 GB
QW
Qwen3.6 40B Fable Fusion 6 Core Deckard Eleanor Heretic Uncensored NM DAU NEO MAX MTP
Qwen · DavidAU
Params39.1B
Context256K
Q4_K_M25.9 GB
RU
rune 26b a4b v3
Rune · Livesport
Params25.2B
Context—
Smallest0.1 GB
OL
Olmo 3.1 32B Instruct
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
MI
MiniCPM V 4.7 35B A3B
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
Mistral 7B Instruct v0.3
Mistral · QuantFactory
Params7.25B
Context32K
Q4_K_M4.4 GB
SP
Spark X2.6 4B LocalAI
Spark · weareapexcreators
Params4.45B
Context1024K
Q4_K_M3.5 GB
GE
Gemma 4 E4B
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
NA
VisionPsy Nano 460M GGUFs
Nanovlm · qvac
Params409M
Context8K
Q4_K_M0.3 GB
GE
Gemma 4 MoonGem 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.5 GB
PR
PreciseCoder 9B
Precisecoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CY
Cyberdonia 24B v8
Cyberdonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · unsloth
Params32.8B
Context128K
Q4_K_M19.9 GB
WI
Wicked Stuff 26B A4B v2.0 Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8-27B
Qwen · NilVoid
Params27.3B
Context256K
Q4_K_M16.6 GB
LY
Lythri-7B-A4B
Lythri · Lythri
Params7.46B
Context128K
Smallest5.7 GB
AG
Agents A1 Uncensored MTP APEX
Agents · SC117
Params35.5B
Context256K
Smallest14.3 GB
OC
Occamy 1.0 Abliterated
Occamy · gbuzhf
Params34.7B
Context256K
Smallest14.5 GB
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v3
Lfm · DuoNeural
Params8.47B
Context125K
Q4_K_M5.2 GB
FI
FinanceGemma E4B
Financegemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
VE
Veloxy Flash 15B
Veloxy · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.6 27B Uncensored Heretic v2 Native MTP Preserved
Qwen · llmfan46
Params27.3B
Context256K
Q4_K_M17.2 GB
MI
MiniCPM V 4.7 35B A3B APEX I MiniPlus V2.1
MiniCPM · IsValorum
Params34.7B
Context256K
Q4_K_M0.2 GB
YI
Yi-1.5-6B-Chat
Yi · bartowski
Params6.06B
Context4K
Q4_K_M3.7 GB
MI
Ministral 3 8B Reasoning 2512
Mistral · mistralai
Params8.49B
Context256K
Q4_K_M5.2 GB
QW
Qwen3.6 27B
Qwen · AtomicChat
Params26.9B
Context256K
Q4_K_M16.5 GB
G9
G9v3 3B
bartowski
Params3B
Context128K
Q4_K_M1.9 GB
SM
Smollm3-3B-128K
SmolLM · unsloth
Params3.08B
Context128K
Q4_K_M1.9 GB
GE
Huihui Gemma 4 E4B It Abliterated
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
KA
KAT Coder V2.5 Dev APEX I MiniPlus V2.1
Kat · IsValorum
Params34.7B
Context256K
Smallest1.2 GB