GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
WR
Wren
Wren · ohmysimo
Params117B
Context256K
Q4_K_M77.6 GB
GGUF
SM
TwIL LM
SmolLM · webAI-Official
Params1.71B
Context8K
Q4_K_M1.1 GB
Reasoning
LF
LFM3 1.7B Heretic Abliterated i1
Lfm · Vortecks
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen Image 2.1 Anime Fusal
Qwen · LocalAI-io
Params7.12B
Context256K
Q4_K_M5.0 GB
Vision
CA
brucethemoose_capytessborosyi-34b-200k-dare-ties
Capytessborosyi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
LL
Llama-3-Aplite-Instruct-4x8B
Llama · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
Coding
QW
Qwen3.8 27B MIX
Qwen · vmarcelo
Params27.3B
Context256K
Smallest12.6 GB
Vision
MI
Minimax-M2.1
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
CO
Cosmos-Reason1-7B
Cosmos · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
MI
MiniMax H3 Turbo
Minimax · molbal
Params20.1B
Context—
Smallest11.4 GB
GGUF
KI
Kimi-K2.6
Kimi · unsloth
Params1030B
Context256K
Smallest340.5 GB
Vision
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · Cyronius
Params132B
Context256K
Smallest64.8 GB
Embedding
PH
dolphin 2 6 phi 2
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
CodingTool use
LT
LTXV 13B 0.9.8 dev
Ltx · QuantStack
Params13B
Context—
Q4_K_M8.8 GB
GGUF
UN
ajibawa-2023_uncensored-jordan-33b
Uncensored · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
ZD
TaichuAI/ZDTaichu5.0-9B
Zdtaichu · ngquocvinh
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
QW
Qwen2.5 3B Instruct
Qwen · ThomasBaruzier
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
WI
ehartford_wizard-vicuna-7b-uncensored
Wizard · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
RU
RusMind 4.7 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
MI
MiniMax-3.1-Flash-DeRisked
Minimax · freakyskittle
Params426B
Context1024K
Q4_K_M258.0 GB
ReasoningTool useVision
MI
Mistral Large Instruct 2411
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
EX
EXAONE-4.0-1.2B
Exaone · LGAI-EXAONE
Params1.28B
Context64K
Q4_K_M0.8 GB
GGUF
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · lmstudio-community
Params74B
Context256K
Smallest22.0 GB
Vision
BA
bagel 34b v0.5 i1
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
CodingRoleplayTool use
QW
Qwen3 Omni 30B A3B Captioner
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
Vision
QW
Onego_Osearch_Popular_Wiki_Qwen05B_V2_Merged
Qwen · onegoai
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
DB
dbrx 16x12b instruct q4 0
Dbrx · phymbert
Params132B
Context32K
Smallest74.2 GB
GGUF
RU
RusMind 4.6.5 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use

Keep browsing