GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
KR
KREA 2 GGUFs
Krea · realrebelai
Params12.9B
Context—
Q4_K_M7.2 GB
AU
Audio Flamingo
Audio · audio-cpp
Params—
Context—
Smallest5.5 GB
QW
Qwen2.5 Omni 7B
Qwen · ggml-org
Params7.6B
Context32K
Q4_K_M4.7 GB
LT
LTX 2.5
Ltx · unsloth
Params21B
Context—
Q4_K_M13.6 GB
GR
Grug 12B
Grug · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
FL
flux 3 image klein
Flux · unsloth
Params5.55B
Context—
Q4_K_M3.7 GB
QW
Huihui Qwen3.8 Flash Next abliterated i1
Qwen · mradermacher
Params177B
Context—
Smallest0.6 GB
FL
Flux2 Klein 9B True V2
Flux · wikeeyang
Params9.08B
Context—
Smallest5.7 GB
QW
Qwen3.8 Flash Next REAP 288 Bf16
Qwen · sh0wie
Params124B
Context256K
Q4_K_M83.8 GB
NE
.nemotron-speech-streaming-en-0.6b.q8_0.gguf
Nemotron · nvidia
Params628M
Context—
Smallest0.7 GB
QW
Qwen3.8 Flash Next IQ2_XXS imatrix trunk, padded Q2_K down, MTP
Qwen · antirez
Params188B
Context256K
Smallest147.2 GB
FL
FLUX.1 Fill dev
Flux · YarvixPA
Params11.9B
Context—
Smallest5.2 GB
LF
LFM2.5 8B A1B
Lfm · LiquidAI
Params8.47B
Context125K
Q4_K_M5.2 GB
LF
LFM2.5-350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
QW
Qwen3.8 Flash Next
Qwen · bartowski
Params177B
Context256K
Q4_K_M119.6 GB
QW
Swift 1.5 Qwen3.8 27B Uncensored Dynamic MTP
Qwen · ajgazin
Params28B
Context256K
Smallest8.8 GB
YO
yovoice model
Yovoice · leemysw
Params—
Context—
Smallest0.3 GB
KR
Krea 2 Turbo
Krea · vantagewithai
Params12.9B
Context—
Q4_K_M7.5 GB
QW
Qwen2.5 Coder 3B Instruct AWQ
Qwen · Qwen
Params3.4B
Context32K
Q4_K_M2.1 GB
NE
NVIDIA Nemotron 3.5 Bolt E4B
Nemotron · unsloth
Params7.52B
Context128K
Smallest0.0 GB
MI
MiniMax H3
Minimax · molbal
Params20.1B
Context—
Smallest11.4 GB
FL
FLUX.2 dev
Flux · unsloth
Params32.2B
Context—
Q4_K_M20.0 GB
FL
FLUX.2 klein base 9B
Flux · unsloth
Params9.08B
Context—
Q4_K_M5.9 GB
QW
Qwen2.5 Omni 3B
Qwen · ggml-org
Params3.4B
Context32K
Q4_K_M2.1 GB
MI
Devstral-Small-2-24B-Instruct-2512
Mistral · unsloth
Params23.6B
Context384K
Q4_K_M14.3 GB
QW
Huihui Qwen3.8 Flash Next Abliterated
Qwen · mradermacher
Params177B
Context256K
Smallest80.4 GB
QW
Qwen3.8 Flash Next Uncensored Gufo Q4Mix
Qwen · vmlinux
Params177B
Context256K
Smallest109.8 GB
QW
Qwen2.5 3B Instruct
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
FL
FLUX.2 dev
Flux · city96
Params32.2B
Context—
Q4_K_M20.1 GB
FL
FLUX.1 Kontext dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB