GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen1.5-1.8B-Chat-AWQ-fp16
Qwen · Qwen
Params1.84B
Context32K
Q4_K_M1.2 GB
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest203.6 GB
GE
Fallen Gemma3 12B v1
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
KI
Kimi K3
Kimi · Blackfrost-AI
Params2780B
Context1024K
Smallest1009.5 GB
KI
moonshotai Kimi K2 Thinking
Kimi · bartowski
Params1030B
Context256K
Q4_K_M624.0 GB
AR
ArmenianGPT 1.0 3B
Armeniangpt · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
LF
LFM2.5-24B-A2B-DSpark
Lfm · LiquidAI
Params328M
Context128K
Smallest0.7 GB
FI
Fireplace 34b
Fireplace · mradermacher
Params34.4B
Context195K
Q4_K_M22.1 GB
SK
SkyReels V2 T2V 14B 720P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
GE
Zero Gemma4 E4B OpenZero
Gemma · shafire
Params7.5B
Context128K
Smallest5.9 GB
KI
Kimi K2.5
Kimi · bartowski
Params1030B
Context256K
Q4_K_M580.4 GB
CO
CodeQwen1.5-7B
Codeqwen · bartowski
Params7.25B
Context64K
Q4_K_M4.7 GB
QW
Qwen3.8 27B DSpark
Qwen · Anbeeld
Params1.86B
Context256K
Q4_K_M1.1 GB
ST
Step 5 Preview
Step · smalinin
Params601B
Context1024K
Smallest1.2 GB
FL
FLUX.2 klein 9B
Flux · drends
Params9.08B
Context—
Q4_K_M5.9 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · bartowski
Params12.3B
Context1024K
Q4_K_M7.5 GB
MU
Muse Spark Open 816B A42B
Muse · Interchained
Params820B
Context1024K
Q4_K_M499.6 GB
LL
nkpz_llama2-22b-daydreamer-v3
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
PR
PromptEnhancer 32B
Promptenhancer · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
LL
Meta Llama 3 70B Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
SK
TheDrummer Skyfall 36B v2
Skyfall · bartowski
Params36.9B
Context32K
Q4_K_M22.4 GB
LL
Llama-3-8B-Irene-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
DE
DeepSeek V2.5 1210
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
LT
LTX2.3 10Eros 1.3
Ltx · chfm
Params21B
Context—
Q4_K_M14.3 GB
GE
Fallen Gemma3 27B V1C
Gemma · TheDrummer
Params27B
Context128K
Q4_K_M16.5 GB
ST
Step 3.5 Flash REAP 149B A11B i1
Step · mradermacher
Params149B
Context256K
Q4_K_M89.9 GB
LL
Bio Medical Llama 3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
ER
Erk 14B
Erk · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB