GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
YI
dolphin-2.2-yi-34b-200k
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GR
Granite 3.1 3b A800M Instruct
Granite · bartowski
Params3.3B
Context128K
Q4_K_M2.0 GB
MI
danielbrdz_barcenas-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen2.5 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GR
Granite 8b Code Base 4k
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
ZE
zed industries zeta 2
Zeta · bartowski
Params8.25B
Context32K
Q4_K_M5.2 GB
QW
Qwen3 4B Base
Qwen · mradermacher
Params4B
Context32K
Q4_K_M2.5 GB
OL
open r1 OlympicCoder 7B
Olympiccoder · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
VI
Vinci MLE 8B 1.0
Vinci · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
CU
CursorCore QW2.5 1.5B i1
Cursorcore · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen_Qwen3 VL 2B Instruct
Qwen · lmstudio-community
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
MARTHA LXVII.8B QWEN 3.5 3.6 prune 9b 3.6 base
Qwen · ZERO-POINT-AI
Params8.1B
Context256K
Q4_K_M5.1 GB
QW
Bella Bartender Qwen3 1.7b
Qwen · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
GW
Vt Gwen 2.5 3b Q4_k_m Gguf
Gwen · vinhnx90
Params3.09B
Context32K
Q4_K_M1.9 GB
GM
GmshNet 8B v0.1
Gmshnet · hexera-org
Params7.62B
Context32K
Q4_K_M4.7 GB
CH
ChemLLM 20B Chat DPO
Chemllm · mradermacher
Params19.9B
Context32K
Q4_K_M12.0 GB
MI
dolphin 2.8 mistral 7b v02
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Qwen Qwen2 Math 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context4K
Q4_K_M4.7 GB
QW
Qwen3.8 27B full Uncensored
Qwen · 0xSojalSec
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 19B A4B It The DECKARD Heretic Uncensored Thinking
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
QW
Qwen3.8 27B TURBO MTP
Qwen · nimbowz
Params27B
Context256K
Q4_K_M18.0 GB
QW
Whittle Qwen 3.8 45B A3B
Qwen · logic65
Params45.1B
Context256K
Q4_K_M27.1 GB
NE
NeuralStar_FusionWriter_4x7b
Neuralstar · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
LL
Replete Coder V2 Llama 3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
MI
teknium_hermes-trismegistus-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GP
Gpt Neox 20b
Gpt · mradermacher
Params20.6B
Context2K
Q4_K_M13.1 GB
LL
Llama3.3 8B Instruct Thinking Claude 4.5 Opus High Reasoning
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
voxtral mini 3b 2507
Mistral · cstr
Params4.68B
Context—
Smallest2.7 GB
YI
Yi 1.5 9B Chat 16K Abliterated
Yi · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB