GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
EX
EXAONE 3.5 2.4B Instruct 2
Exaone · ThomasBaruzier
Params2.67B
Context32K
Q4_K_M1.6 GB
QW
Qwen3.8 Flash Next
Qwen · apetersson
Params126B
Context256K
Smallest2.8 GB
QW
Swift Qwen3.8 Flash Next Q4 0 Q8out v3
Qwen · nitinpanj
Params177B
Context256K
Smallest102.6 GB
LF
LFM2 350M Extract
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
MI
Midnight Miqu 70B v1.0 i1
Midnight · mradermacher
Params69B
Context32K
Q4_K_M41.7 GB
MI
MiniMax H3 x Z Image
Minimax · joeygambino
Params20.1B
Context—
Smallest11.5 GB
NE
Nemotron 3.5 Bolt E4B Heretic
Nemotron · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
AI
Airoboros 33B 2.1
Airoboros · TheBloke
Params32.5B
Context4K
Q4_K_M19.6 GB
FL
FLUX.3 Image Klein
Flux · DogukanUrker
Params5.55B
Context—
Smallest2.5 GB
EX
EXAONE 3.5 2.4B Instruct
Exaone · lmstudio-community
Params2.67B
Context32K
Q4_K_M1.6 GB
IQ
IQuest Coder V1 40B Instruct
Iquest · mradermacher
Params39.8B
Context128K
Q4_K_M24.0 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B NVFP4
Nemotron · tngtech
Params31.6B
Context1024K
Smallest2.0 GB
SE
Seed X PPO 7B
Seed · mradermacher
Params7.51B
Context32K
Q4_K_M4.6 GB
IN
Internlm2 Math Base 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
AI
airoboros l2 70B GPT4 2.0
Airoboros · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
FL
PornMaster flux2 klein 9b
Flux · VenerableRolliPolli
Params8.19B
Context256K
Q4_K_M5.0 GB
NE
Nemotron-3.5-Bolt-E4B-Heretic
Nemotron · grumd0
Params7.46B
Context64K
Smallest3.7 GB
KI
Kimodo-G1-RP-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
DE
Deepseek Coder 6.7b Instruct
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
Mistral Small Drummer 22B
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
FL
Flux2 Klein 9b Uncensored Text Encoder
Flux · wy8edhuh
Params8.19B
Context40K
Smallest6.7 GB
QW
Qwen2.5 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
SK
SkyReels V2 I2V 14B 720P
Skyreels · ThePun1sher
Params16.4B
Context—
Q4_K_M10.9 GB
EX
EXAONE 3.5 7.8B Instruct
Exaone · ThomasBaruzier
Params7.8B
Context32K
Q4_K_M4.8 GB
QW
ThinCtx Qwen3.5 4B
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LF
LFM2.5 2.6B Uncensored Trial65
Lfm · SC117
Params2.7B
Context125K
Q4_K_M1.7 GB
QW
QVQ 72B Preview
Qwen · bartowski
Params72.7B
Context125K
Q4_K_M47.4 GB
WI
ehartford_wizardlm-30b-uncensored
Wizardlm · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
LF
LFM3-Omni-2B
Lfm · AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
FU
Fugaku-LLM-13B-instruct
Fugaku · mmnga
Params13.4B
Context2K
Q4_K_M9.6 GB