GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
EX
EXAONE 3.5 2.4B Instruct 2
Exaone · ThomasBaruzier
Params2.67B
Context32K
Q4_K_M1.6 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · apetersson
Params126B
Context256K
Smallest2.8 GB
Vision
QW
Swift Qwen3.8 Flash Next Q4 0 Q8out v3
Qwen · nitinpanj
Params177B
Context256K
Smallest102.6 GB
Vision
LF
LFM2 350M Extract
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
MI
Midnight Miqu 70B v1.0 i1
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
GGUF
MI
MiniMax H3 x Z Image
Minimax · joeygambino
Params20.1B
Context—
Smallest11.5 GB
GGUF
NE
Nemotron 3.5 Bolt E4B Heretic
Nemotron · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
AI
Airoboros 33B 2.1
Airoboros · TheBloke
Params32.5B
Context4K
Q4_K_M19.6 GB
GGUF
FL
FLUX.3 Image Klein
Flux · DogukanUrker
Params5.55B
Context—
Smallest2.5 GB
GGUF
EX
EXAONE 3.5 2.4B Instruct
Exaone · lmstudio-community
Params2.67B
Context32K
Q4_K_M1.6 GB
GGUF
IQ
IQuest Coder V1 40B Instruct
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
Coding
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4
Nemotron · tngtech
Params31.6B
Context1024K
Smallest2.0 GB
GGUF
SE
Seed X PPO 7B
Seed · mradermacher
Params7.51B
Context32K
Q4_K_M4.6 GB
GGUF
IN
Internlm2 Math Base 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
AI
airoboros l2 70B GPT4 2.0
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
FL
PornMaster flux2 klein 9b
Flux · VenerableRolliPolli
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF
NE
Nemotron-3.5-Bolt-E4B-Heretic
Nemotron · grumd0
Params7.46B
Context64K
Smallest3.7 GB
ReasoningTool useVision
KI
Kimodo-G1-RP-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
GGUF
DE
Deepseek Coder 6.7b Instruct
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MI
Mistral Small Drummer 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
FL
Flux2 Klein 9b Uncensored Text Encoder
Flux · wy8edhuh
Params8.19B
Context40K
Smallest6.7 GB
Coding
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
SK
SkyReels V2 I2V 14B 720P
Skyreels · ThePun1sher
Params16.4B
Context—
Q4_K_M10.9 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct
Exaone · ThomasBaruzier
Params7.8B
Context32K
Q4_K_M4.8 GB
GGUF
QW
ThinCtx Qwen3.5 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
LF
LFM2.5 2.6B Uncensored Trial65
Lfm · SC117
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
QW
QVQ 72B Preview
Qwen · bartowski
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
WI
ehartford_wizardlm-30b-uncensored
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LF
LFM3-Omni-2B
Lfm · AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
FU
Fugaku-LLM-13B-instruct
Fugaku · mmnga
Params13.4B
Context2K
Q4_K_M9.6 GB
GGUF

Keep browsing