GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
qwen3 tts 1.7b customvoice
Qwen · cstr
Params1.92B
Context—
Smallest2.0 GB
QW
Qwen3.8 27B
Qwen · prithivMLmods
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · llmfan46
Params79.7B
Context256K
Q4_K_M49.8 GB
CO
Cohere Transcribe
Cohere · handy-computer
Params2.05B
Context—
Q4_K_M1.6 GB
QW
Qwen3 14B
Qwen · ggml-org
Params14.8B
Context40K
Q4_K_M9.0 GB
SM
SmolLM2 135M
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
MI
MiniCPM5 2B
MiniCPM · bartowski
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
MU
Muse Glimmer 30B
Muse · NANI-Nithin
Params28B
Context128K
Q4_K_M16.9 GB
MA
ms marco MiniLM L6 v2 Q8 0
Marco · sinjab
Params23M
Context512
Smallest0.0 GB
GP
Gpt Oss 20b
gpt-oss · bartowski
Params20.9B
Context128K
Q4_K_M11.7 GB
QW
Qwen3.5 9B Heretic v2
Qwen · filvyb
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
ThinkingCap gemma 4 26B A4B it
Gemma · bottlecapai
Params25.2B
Context256K
Q4_K_M17.0 GB
NE
NeoHorse-1-9B
Neohorse · TokenRhythm
Params8.95B
Context256K
Q4_K_M5.6 GB
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
SE
SenseNova 6.8 Code2Video GSQ RCO
Sensenova · OliviaRossi
Params26.9B
Context256K
Smallest10.2 GB
JA
JackOD 9B Coder
Jackod · ManniX-ITA
Params8.95B
Context256K
Q4_K_M5.6 GB
WH
Whisper Small (English)
Whisper · handy-computer
Params242M
Context—
Q4_K_M0.2 GB
GE
Huihui gemma 4 12B agentic fable5 abliterated
Gemma · huihui-ai
Params11.9B
Context256K
Smallest0.9 GB
GP
Gpt Oss 120b Uncensored
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
QW
Qwen3.8 27B EfficientThink VAL APEX I MiniPlus V3
Qwen · IsValorum
Params27.3B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.8-27B
Qwen · jrell
Params27.3B
Context256K
Smallest13.5 GB
QW
Qwen3.5 9B GLM5.1 Distill v1
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
cognitivecomputations_dolphin-2.7-mixtral-8x7b
Mistral · TheBloke
Params46.7B
Context32K
Q4_K_M26.4 GB
WI
Wicked Stuff 26B A4B v2.1 Final
Wicked · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
IM
Impish_Bloodmoon_12B
Impish · SicariusSicariiStuff
Params12.2B
Context128K
Q4_K_M7.5 GB
HO
K2 Horizon 7B Heretic
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
QW
Qwen3 30B A3B
Qwen · lmstudio-community
Params30.5B
Context32K
Q4_K_M18.6 GB
MI
teknium_openhermes-2.5-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Devstral-Small-2507
Mistral · unsloth
Params23.6B
Context128K
Q4_K_M14.3 GB