GGUF models: apache-2.0 license
86256 GGUF models listed under the apache-2.0 license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 1570B parameters. The longest trained context is 795898K tokens.
QW
Liberation Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
EL
ElementalRP i1
Elementalrp · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
PR
Prashna 7b
Prashna · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MA
Mario Html v2 9B
Mario · bartowski
Params9.2B
Context256K
Q4_K_M6.0 GB
TE
q-bert_terminis-7b
Terminis · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
KA
KAT Ornith HERO 35B A3B Fusion
Kat · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
DA
DataPilot ArrowPro 7B RobinHood
Datapilot · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
QW
Qwen3.8-Distilled-9B-NPU2
Qwen · Atomic-Germ
Params8.95B
Context256K
Smallest9.5 GB
FL
FLUX.2 klein 4B
Flux · adithya-balaji
Params3.88B
Context—
Smallest1.6 GB
QW
Qwen3.5 0.8B Finetuned Lora Uncensored
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
MI
monology_openinstruct-mistral-7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3 VL 4B Instruct Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
QW
flux2 klein 4B uncensored text encoder
Qwen · Cordux
Params4B
Context—
Smallest2.4 GB
QW
Qwen3.5 4B Instruct
Qwen · openresearchtools
Params4.21B
Context256K
Q4_K_M2.7 GB
GL
Glm-4.7-Flash
GLM · mudler
Params29.9B
Context198K
Smallest11.9 GB
HO
K2 Horizon 32B
Horizon · IFM
Params34.8B
Context512K
Q4_K_M21.1 GB
QV
QVikhr 3 4B Instruction
Qvikhr · Vikhrmodels
Params4B
Context40K
Q4_K_M2.5 GB
QW
Qwen3.8 27B NVFP4 MTP SSMFIX
Qwen · esatapedico
Params461M
Context256K
Smallest14.9 GB
HU
Humanizer
Humanizer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
MI
MinerU2.5 Pro 2605 1.2B
Mineru · mradermacher
Params494M
Context8K
Q4_K_M0.4 GB
QW
Qwen2-7B-Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
FL
Flan T5 Xxl
Flan · easygoing0114
Params4.76B
Context512
Q4_K_M2.9 GB
CL
Clef Flash
Clef · taurusduan
Params9.1B
Context256K
Q4_K_M6.0 GB
QW
Qwen3.8 9B Distill Uncen Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
MI
Mixtral AI CyberTron Ultra
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LA
laya_multilingual_unsloth_dynamic
Laya · mys
Params323M
Context—
Q4_K_M0.5 GB
PH
Athene Phi 3.5 mini instruct orpo
Phi · bartowski
Params3.82B
Context128K
Q4_K_M2.3 GB
QW
Qwen3.8 27B NVFP4 MTP Q8attn
Qwen · utautako
Params461M
Context256K
Smallest17.4 GB