GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8-Flash-Next
Qwen · ji-farthing
Params177B
Context256K
Smallest2.4 GB
DE
deepseek-ai_deepseek-coder-1.3b-base
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
LF
LFM2.5 24B A2B
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
LF
LFM2.5 24B A2B
Lfm · bartowski
Params24B
Context128K
Q4_K_M15.4 GB
QW
Qwen Image 2.1 viggle turbo v0.2.1 6step
Qwen · Abiray
Params7.12B
Context—
Q4_K_M4.2 GB
ME
Medgemma 4b It
Medgemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
WE
WestLake 10.7B v2
Westlake · backyardai
Params10.7B
Context32K
Q4_K_M6.5 GB
FL
Flux2 Klein 9b Uncensored Text Encoder
Flux · WANG-CC
Params8.19B
Context40K
Smallest8.7 GB
NE
Nvidia-Nemotron-3-Ultra-550B-A55B
Nemotron · unsloth
Params550B
Context1024K
Q4_K_M359.2 GB
HU
HunyuanOCR
Hunyuanocr · ggml-org
Params539M
Context32K
Smallest0.6 GB
QW
dolphin-2.9.2-qwen2-72b
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
DR
Drex v1.5
Drex · nace-ai
Params9B
Context256K
Smallest9.5 GB
QW
Swift 1.5 Qwen3.8 Flash Next REAP Pruned
Qwen · 90-008
Params109B
Context256K
Smallest55.3 GB
QW
Qwen3.8 Flash Next Heretic2 IQ4XS NGQ4
Qwen · cygnal
Params177B
Context256K
Smallest98.4 GB
FL
FLUX.2 Klein 9B KV
Flux · QuantStack
Params9.08B
Context—
Q4_K_M5.7 GB
QW
Swift 1.5 Qwen3.8 27b MXFP4
Qwen · tsaipifong
Params27.3B
Context256K
Smallest15.5 GB
QW
Qwen3.8 Flash Next
Qwen · AesSedai
Params180B
Context256K
Q4_K_M116.1 GB
FL
flux imatrix
Flux · Eviation
Params11.9B
Context—
Q4_K_M6.7 GB
LF
LFM2.5-8B-A1B-Uncensored-Gaston
Lfm · gaston-parravicini
Params8.47B
Context125K
Q4_K_M5.2 GB
LT
LTX 2.5 Comfy
Ltx · ruygar
Params21B
Context—
Smallest7.3 GB
ER
10Eros Max Turbo Hybrid Beta5
Eros · Abiray
Params20.1B
Context—
Q4_K_M11.6 GB
FU
sayit asr
Fun · cswk
Params830M
Context—
Q4_K_M0.5 GB
QW
Qwen2.5-Omni-3B
Qwen · unsloth
Params3.4B
Context32K
Q4_K_M2.1 GB
NE
Nemotron 3.5 Bolt E4B GSQ RCO
Nemotron · abenzerps
Params7.52B
Context128K
Smallest0.4 GB
IN
InternLM2
InternLM · legraphista
Params7.74B
Context8K
Smallest1.9 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B Pollard
Nemotron · PollardWeights
Params7.52B
Context128K
Q4_K_M0.2 GB
MI
Mistral Small Instruct 2409
Mistral · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
QW
Qwen2.5 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
LL
dolphin 2.9 llama3 8b
Llama · dphn
Params8B
Context8K
Q4_K_M4.9 GB