GGUF models: apache-2.0 license

86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
openchat_openchat-3.5-1210
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
MI
MiniCPM V 4_6 Thinking
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningVision
CL
Clover-35B-A3B-Preview
Clover · Diffuspace
Params34.7B
Context128K
Q4_K_M23.0 GB
ReasoningTool use
HU
humanizer-12b
Humanizer · ngquocvinh
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
AE
AesCode 8B
Aescode · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Coding
QW
Qwen3.6 35B A3B Uncensored MTP
Qwen · mecha-factory
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
QW
PAW 125B FLASH NEXT X3.1
Qwen · lackonendes
Params79.3B
Context—
Smallest1.0 GB
GGUF
QW
JoyFox Qwen3.6 35B A3B RP Aggressive
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
RoleplayVision
GR
Granite-4.0-H-Small
Granite · unsloth
Params32.2B
Context1024K
Q4_K_M19.6 GB
GGUF
GE
Gemma 4 31B It Scotoma 2
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
QW
Whittle Qwen 3.8 35B A3B
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.3 GB
CodingReasoning
MI
Ministral 3 8B Instruct 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
QW
Qwen2.5 VL 32B Geometry
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
AE
AesCode 8B
Aescode · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
CodingVision
JA
Jan-nano-128k
Jan · Menlo
Params4B
Context128K
Q4_K_M2.5 GB
GGUF
AV
Avrik Pro 12B
Avrik · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
QW
Qwen3 VL Embedding 8B
Qwen · mradermacher
Params7.57B
Context256K
Q4_K_M4.7 GB
EmbeddingVision
OP
openbuddy_openbuddy-zephyr-7b-v14.1
Openbuddy · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
LO
LongWriter Zero 32B
Longwriter · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.5 122B A10B Abliterix
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
QW
Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3-30B-A3B-128K
Qwen · unsloth
Params30.5B
Context128K
Q4_K_M18.6 GB
GGUF
QW
Qwen3 4b Z Image Engineer V4
Qwen · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
ME
G4 MeroMero 31B Uncensored Heretic
Meromero · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
QW
Qwen3.8 27B Uncensored noMTP Q4 K M OpenCode
Qwen · oceanonline
Params27B
Context256K
Q4_K_M16.5 GB
Tool use
SU
Sulphur 2 Prompt Enhancer Uncensored
Sulphur · PeppX
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwopus3.5 9B v3
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
IN
InternVL3_5 38B
Internvl · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
Vision
IN
InternVL3_5 38B
Internvl · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
CodingVision

Keep browsing