GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QU
Quill v1 imatrix
Quill · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Llama 4 Scout 17B 16E Instruct
Llama · second-state
Params108B
Context10240K
Q4_K_M65.4 GB
WI
WizardLM 13B Uncensored
Wizardlm · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
LT
LTX 2.3 DISTILLED
Ltx · FenomAI
Params21B
Context—
Q4_K_M14.2 GB
QW
Sakura Qwen3.8 Flash Next Compact Swift IQ3 XXS 352E CP2
Qwen · webmp3
Params139B
Context256K
Smallest2.6 GB
TI
TIPO 200M
Tipo · KBlueLeaf
Params203M
Context2K
Smallest0.4 GB
HE
HelpingAI2.5 2B
Helpingai · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GE
Gemma 2 2b It
Gemma · duyntnet
Params2.61B
Context8K
Q4_K_M1.7 GB
FL
FLUX.1 Fill dev
Flux · gaianet
Params84M
Context—
Smallest0.3 GB
QW
Qwen2.5 VL 7B Meteorology
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
qwenimage21
Qwen · wwdsada
Params7.12B
Context—
Q4_K_M4.2 GB
ME
Medgemma 1.5 4b It
Medgemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.8 Flash Next ROCmFP4 STRIX LEAN
Qwen · kingjones777
Params177B
Context256K
Smallest105.8 GB
MI
minicpm5 1B GLM 5.2 Agentic v3
MiniCPM · hudsongouge
Params1.08B
Context128K
Q4_K_M0.7 GB
GE
gemma-2b
Gemma · leliuga
Params2.51B
Context8K
Q4_K_M1.6 GB
NE
Nemotron 3.5 Embed 1B
Nemotron · maternion
Params1.14B
Context256K
Smallest0.9 GB
OP
OpenCoder 8B Instruct
Opencoder · QuantFactory
Params7.77B
Context8K
Q4_K_M4.7 GB
MI
Llama 3.1 Nemotron 70B Instruct HF
Mistral · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M13.3 GB
LL
Bio Medical Llama 3 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.5 122B A10B REAP 20
Qwen · mradermacher
Params99B
Context256K
Q4_K_M60.2 GB
CO
Cosmos Reason1 7B
Cosmos · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen Image 2.1 Companions
Qwen · off-grid-ai
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
larryvrh_yi-34b-200k-llamafied
Llama · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
AN
Anima aesthetic v1.0
Anima · Abiray
Params2.09B
Context—
Q4_K_M1.4 GB
OP
OpenOrca-Platypus2-13B
Openorca · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
RU
RusMind Malysh 4.7
Rusmind · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
LL
Meta Llama Guard 2 8B
Llama · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
OM
Omni Edu 4B
Omni · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
TEMPURA Qwen2.5 VL 3B s2
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
KE
KernelLLM
Kernelllm · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB