GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
OP
openchat_openchat-3.5-1210
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
MiniCPM V 4_6 Thinking
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
CL
Clover-35B-A3B-Preview
Clover · Diffuspace
Params34.7B
Context128K
Q4_K_M23.0 GB
HU
humanizer-12b
Humanizer · ngquocvinh
Params11.9B
Context256K
Q4_K_M7.4 GB
AE
AesCode 8B
Aescode · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3.6 35B A3B Uncensored MTP
Qwen · mecha-factory
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
PAW 125B FLASH NEXT X3.1
Qwen · lackonendes
Params79.3B
Context—
Smallest1.0 GB
QW
JoyFox Qwen3.6 35B A3B RP Aggressive
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GR
Granite-4.0-H-Small
Granite · unsloth
Params32.2B
Context1024K
Q4_K_M19.6 GB
GE
Gemma 4 31B It Scotoma 2
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
QW
Whittle Qwen 3.8 35B A3B
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.3 GB
MI
Ministral 3 8B Instruct 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
QW
Qwen2.5 VL 32B Geometry
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
AE
AesCode 8B
Aescode · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
JA
Jan-nano-128k
Jan · Menlo
Params4B
Context128K
Q4_K_M2.5 GB
AV
Avrik Pro 12B
Avrik · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3 VL Embedding 8B
Qwen · mradermacher
Params7.57B
Context256K
Q4_K_M4.7 GB
OP
openbuddy_openbuddy-zephyr-7b-v14.1
Openbuddy · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
LO
LongWriter Zero 32B
Longwriter · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3.5 122B A10B Abliterix
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3-30B-A3B-128K
Qwen · unsloth
Params30.5B
Context128K
Q4_K_M18.6 GB
QW
Qwen3 4b Z Image Engineer V4
Qwen · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
ME
G4 MeroMero 31B Uncensored Heretic
Meromero · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.8 27B Uncensored noMTP Q4 K M OpenCode
Qwen · oceanonline
Params27B
Context256K
Q4_K_M16.5 GB
SU
Sulphur 2 Prompt Enhancer Uncensored
Sulphur · PeppX
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwopus3.5 9B v3
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
IN
InternVL3_5 38B
Internvl · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
IN
InternVL3_5 38B
Internvl · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB