GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
OM
Omega Arsenal 31B Final
Omega · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
PP
pplx decider v1.1 27b
Pplx · Livesport
Params25.6B
Context—
Smallest0.0 GB
GGUF
JE
Jebadiah 9b v2
Jebadiah · frontier-infra
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF
OL
allenai_olmOCR 2 7B 1025
OLMo · lmstudio-community
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen38 27b Heretic Ara
Qwen · cygnal
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3-235B-A22B
Qwen · unsloth
Params235B
Context40K
Q4_K_M142.2 GB
GGUF
QW
Qwen3 Sex
Qwen · ystemsrx
Params4B
Context256K
Smallest4.3 GB
GGUF
QW
Qwen3.5 4B Claude 4.6 Opus Reasoning Distilled v2
Qwen · Jackrong
Params4.2B
Context256K
Q4_K_M2.7 GB
ReasoningVision
QW
Jev Style Qwen3.5 2B Decision
Qwen · chaoliangUNSW
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
QW
Qwen Image 2.1 Text Encoder
Qwen · darrellbest
Params8.2B
Context256K
Q4_K_M5.7 GB
CodingVision
OM
Omega Arsenal 31B Final
Omega · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
QW
Qwen3.8 27B
Qwen · DhruvalLabs
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
SM
SmolLM2 135M Instruct
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
ME
G4 MeroMero v2 31B
Meromero · zerofata
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen2.5-14B-Instruct-1M
Qwen · Mungert
Params14.8B
Context986K
Q4_K_M9.2 GB
GGUF
QW
Qwen3.8 27B
Qwen · KikoCis
Params26.9B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
MI
Mistral-7B-Instruct-v0.3
Mistral · lmstudio-community
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.8-27B GSQ-RCO
Qwen · cruizba
Params27.3B
Context256K
Smallest8.6 GB
GGUF
MI
MiniCPM V 4.7 1B abliterated heretic
MiniCPM · Abiray
Params1.01B
Context256K
Q4_K_M0.7 GB
Vision
FL
mindview-t2i
Flux · mohsenvand
Params4.65B
Context—
Smallest1.2 GB
GGUF
QW
Qwen3.8 27B Q4 K M
Qwen · Abiray
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3 Coder 30B A3B
Qwen · AtomicChat
Params30.5B
Context256K
Q4_K_M18.6 GB
CodingTool use
QW
Qwen3.5 9B Heretic
Qwen · darrellbest
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
QW
Qwen3.8-27B-Abliterated
Qwen · windowsxp811203
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen2.5 7B Instruct
Qwen · paultimothymooney
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
IN
InternVL3_5 8B
Internvl · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
Vision
MI
Sharp MiniCPM5 2B
MiniCPM · peculiar-ragdoll
Params2.52B
Context—
Smallest0.0 GB
GGUF
GE
gemma 4 E2B it
Gemma · AtomicChat
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
HU
Humanizer
Humanizer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
ON
OneJev 27B
Onejev · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
Vision

Keep browsing