GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
NE
Nemotron Speech Streaming EN
Nemotron · handy-computer
Params618M
Context—
Q4_K_M0.5 GB
QW
Qwen3.8 Flash Next
Qwen · agentionai
Params117B
Context256K
Smallest75.8 GB
LF
LFM3 Audio 2B
Lfm · LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
LT
LTXV 13B 0.9.8 distilled
Ltx · QuantStack
Params13B
Context—
Q4_K_M8.8 GB
ST
stable diffusion 3.5 medium
Stable · second-state
Params695M
Context—
Smallest0.1 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Huihui Qwen3.8 Flash Next abliterated NVFP4 GPTQ Strata
Qwen · Maximilian228
Params4.95B
Context—
Smallest1.3 GB
GL
Glm 4 9b Chat
GLM · QuantFactory
Params9.4B
Context128K
Q4_K_M6.3 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B 24GB LiLiCorr
Nemotron · nvidia
Params1.11B
Context256K
Smallest1.0 GB
FL
FLUX.1 Krea dev
Flux · QuantStack
Params11.9B
Context—
Q4_K_M6.9 GB
QW
OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4
Qwen · auto7x
Params126B
Context—
Smallest0.9 GB
QW
Swift 1.5 Qwen3.8 27b
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
NE
Models Nvidia NVIDIA Nemotron Nano 12B v2
Nemotron · MaziyarPanahi
Params12.3B
Context1024K
Q4_K_M7.5 GB
QW
Qwen3.8 Flash Next abliterated GSQ RCO Coder Strata
Qwen · alesha-pro
Params—
Context—
Smallest0.0 GB
LF
Lfm2.5-8B-A1B
Lfm · unsloth
Params8.47B
Context125K
Q4_K_M5.3 GB
LF
Lfm2.5-Vl-3B
Lfm · unsloth
Params2.7B
Context125K
Q4_K_M1.7 GB
FU
Fun-ASR Nano
Fun · handy-computer
Params830M
Context—
Q4_K_M0.6 GB
NE
NVIDIA Nemotron 3.5 Transcribe 30B A4B
Nemotron · AtomicChat
Params32.9B
Context1024K
Smallest0.1 GB
MI
Sakura MiniMax H3
Minimax · webmp3
Params20.1B
Context—
Q4_K_M12.6 GB
SU
Sulphur 2 Base
Sulphur · vantagewithai
Params21B
Context—
Q4_K_M14.3 GB
LL
dolphin 2.9 llama3 8b
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
FL
FLUX 3 Image Klein
Flux · AtomicChat
Params5.55B
Context256K
Smallest2.5 GB
TU
SD Turbo
Turbo · Green-Sky
Params1.3B
Context—
Smallest2.0 GB
DE
DeepSeek V4.1 Flash UNCENSORED Protium
DeepSeek · Solstice-AI
Params748B
Context1024K
Q4_K_M426.1 GB
NE
NVIDIA-Nemotron-3.5-Bolt-74B-A9B
Nemotron · AtomicChat
Params74B
Context256K
Q4_K_M51.7 GB
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · nvidia
Params3.97B
Context1024K
Q4_K_M2.8 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · AtomicChat
Params32.9B
Context1024K
Q4_K_M25.0 GB
KR
krea 2
Krea · gguf-org
Params12.8B
Context—
Smallest0.3 GB
BR
breeze-tts-2
Breeze · cstr
Params2.85B
Context—
Smallest2.2 GB
FL
flux2 klein 9b uncensored text encoder
Flux · ponpoke
Params8.19B
Context—
Q4_K_M5.0 GB