GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
WR
Wren
Wren · ohmysimo
Params117B
Context256K
Q4_K_M77.6 GB
SM
TwIL LM
SmolLM · webAI-Official
Params1.71B
Context8K
Q4_K_M1.1 GB
LF
LFM3 1.7B Heretic Abliterated i1
Lfm · Vortecks
Params1.73B
Context256K
Q4_K_M1.1 GB
QW
Qwen Image 2.1 Anime Fusal
Qwen · LocalAI-io
Params7.12B
Context256K
Q4_K_M5.0 GB
CA
brucethemoose_capytessborosyi-34b-200k-dare-ties
Capytessborosyi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
LL
Llama-3-Aplite-Instruct-4x8B
Llama · mradermacher
Params24.9B
Context8K
Q4_K_M15.2 GB
QW
Qwen3.8 27B MIX
Qwen · vmarcelo
Params27.3B
Context256K
Smallest12.6 GB
MI
Minimax-M2.1
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
CO
Cosmos-Reason1-7B
Cosmos · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
MI
MiniMax H3 Turbo
Minimax · molbal
Params20.1B
Context—
Smallest11.4 GB
KI
Kimi-K2.6
Kimi · unsloth
Params1030B
Context256K
Smallest340.5 GB
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.8 Flash Next
Qwen · Cyronius
Params132B
Context256K
Smallest64.8 GB
PH
dolphin 2 6 phi 2
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
LT
LTXV 13B 0.9.8 dev
Ltx · QuantStack
Params13B
Context—
Q4_K_M8.8 GB
UN
ajibawa-2023_uncensored-jordan-33b
Uncensored · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
ZD
TaichuAI/ZDTaichu5.0-9B
Zdtaichu · ngquocvinh
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 3B Instruct
Qwen · ThomasBaruzier
Params3.09B
Context32K
Q4_K_M1.9 GB
WI
ehartford_wizard-vicuna-7b-uncensored
Wizard · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
RU
RusMind 4.7 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB
MI
MiniMax-3.1-Flash-DeRisked
Minimax · freakyskittle
Params426B
Context1024K
Q4_K_M258.0 GB
MI
Mistral Large Instruct 2411
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
EX
EXAONE-4.0-1.2B
Exaone · LGAI-EXAONE
Params1.28B
Context64K
Q4_K_M0.8 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · lmstudio-community
Params74B
Context256K
Smallest22.0 GB
BA
bagel 34b v0.5 i1
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
QW
Qwen3 Omni 30B A3B Captioner
Qwen · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
QW
Onego_Osearch_Popular_Wiki_Qwen05B_V2_Merged
Qwen · onegoai
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
DB
dbrx 16x12b instruct q4 0
Dbrx · phymbert
Params132B
Context32K
Smallest74.2 GB
RU
RusMind 4.6.5 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Q4_K_M3.4 GB