GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
VL
vllm-d3
ggml-org
Params26.9B
Context256K
Q4_K_M19.4 GB
QW
Qwen3 ASR 0.6B
Qwen · unslothai
Params752M
Context64K
Smallest0.8 GB
QW
Qwen3.8 27B Uncensored Heretic Native MTP Preserved
Qwen · llmfan46
Params27.3B
Context256K
Q4_K_M17.6 GB
GE
Gemma 4 26B A4B It Ultra Uncensored Heretic
Gemma · llmfan46
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Huihui Qwen3.5 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.6 35B A3B abliterated
Qwen · wangzhang
Params34.7B
Context256K
Q4_K_M21.2 GB
SM
smollm2 360m aac watch
SmolLM · dcostenco
Params362M
Context8K
Smallest0.2 GB
QW
Qwen3-Vl-32B-Instruct
Qwen · unsloth
Params32.8B
Context256K
Q4_K_M19.8 GB
TI
TinyMistral 248M v2 Instruct
Tinymistral · M4-ai
Params248M
Context32K
Q4_K_M0.2 GB
QW
Qwen3.8 27B Unleashed
Qwen · outsourc-e
Params27B
Context256K
Q4_K_M16.5 GB
LA
Laya
Laya · ggml-org
Params421M
Context8K
Smallest0.4 GB
QW
Models Qwen Qwen3 Coder Next
Qwen · MaziyarPanahi
Params79.7B
Context256K
Q4_K_M48.4 GB
HO
K2 Horizon MoVA 36B A4B
Horizon · IFM
Params37.4B
Context512K
Q4_K_M22.4 GB
SP
Spark X2.6 4B Abliterated
Spark · SC117
Params4.11B
Context1024K
Q4_K_M2.7 GB
QW
Qwen3 0.6b Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
QW
Whittle Qwen 3.8 35B A3B
Qwen · logic65
Params35.5B
Context256K
Q4_K_M21.3 GB
AG
Agents A1
Agents · InternScience
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
MiniCPM-V-4.7-35B-A3B
MiniCPM · AtomicChat
Params34.7B
Context256K
Smallest10.1 GB
GP
Models ArliAI Gpt Oss 20b Derestricted
gpt-oss · MaziyarPanahi
Params20.9B
Context128K
Q4_K_M15.8 GB
MI
mistralai_Ministral 3 3B Instruct 2512 BF16
Mistral · lmstudio-community
Params3.43B
Context256K
Q4_K_M2.1 GB
NE
NeoHorse 1 4B
Neohorse · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
MU
Muse Glimmer 30B
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
QW
Qwen3 Next 80B A3B Instruct
Qwen · Qwen
Params80B
Context256K
Q4_K_M48.4 GB
MI
mistralai_mixtral-8x7b-instruct-v0.1
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
MI
Devstral Small 2 24B Instruct 2512
Mistral · bartowski
Params23.6B
Context384K
Q4_K_M14.3 GB
QW
Qwen3 VL 2B Instruct
Qwen · ggml-org
Params1.72B
Context256K
Smallest1.8 GB
GP
Huihui Gpt Oss 20b Mxfp4 Abliterated v2
gpt-oss · huihui-ai
Params20.9B
Context128K
Smallest13.8 GB
QW
Qwen3.8 27B Uncensored
Qwen · BnhHo
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen Image Edit
Qwen · QuantStack
Params20.4B
Context—
Q4_K_M13.1 GB
QW
Qwen3.8-27B-DFlash2
Qwen · incoai
Params1.92B
Context256K
Q4_K_M1.1 GB