GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen1.5-1.8B-Chat-AWQ-fp16
Qwen · Qwen
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
OR
Orca 2 13b
Orca · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
MiniMax-M3.1-Flash
Minimax · webmp3
Params426B
Context—
Smallest203.6 GB
GGUF
GE
Fallen Gemma3 12B v1
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
KI
Kimi K3
Kimi · Blackfrost-AI
Params2780B
Context1024K
Smallest1009.5 GB
ReasoningTool use
KI
moonshotai Kimi K2 Thinking
Kimi · bartowski
Params1030B
Context256K
Q4_K_M624.0 GB
Reasoning
AR
ArmenianGPT 1.0 3B
Armeniangpt · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Reasoning
LF
LFM2.5-24B-A2B-DSpark
Lfm · LiquidAI
Params328M
Context128K
Smallest0.7 GB
ReasoningTool use
FI
Fireplace 34b
Fireplace · mradermacher
Params34.4B
Context195K
Q4_K_M22.1 GB
CodingTool use
SK
SkyReels V2 T2V 14B 720P
Skyreels · ThePun1sher
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
GE
Zero Gemma4 E4B OpenZero
Gemma · shafire
Params7.5B
Context128K
Smallest5.9 GB
Tool use
KI
Kimi K2.5
Kimi · bartowski
Params1030B
Context256K
Q4_K_M580.4 GB
Vision
CO
CodeQwen1.5-7B
Codeqwen · bartowski
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.8 27B DSpark
Qwen · Anbeeld
Params1.86B
Context256K
Q4_K_M1.1 GB
CodingEmbedding
ST
Step 5 Preview
Step · smalinin
Params601B
Context1024K
Smallest1.2 GB
GGUF
FL
FLUX.2 klein 9B
Flux · drends
Params9.08B
Context—
Q4_K_M5.9 GB
GGUF
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · bartowski
Params12.3B
Context1024K
Q4_K_M7.5 GB
GGUF
MU
Muse Spark Open 816B A42B
Muse · Interchained
Params820B
Context1024K
Q4_K_M499.6 GB
GGUF
LL
nkpz_llama2-22b-daydreamer-v3
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
PR
PromptEnhancer 32B
Promptenhancer · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
GGUF
LL
Meta Llama 3 70B Instruct
Llama · mmnga
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
SK
TheDrummer Skyfall 36B v2
Skyfall · bartowski
Params36.9B
Context32K
Q4_K_M22.4 GB
GGUF
LL
Llama-3-8B-Irene-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
DE
DeepSeek V2.5 1210
DeepSeek · bartowski
Params236B
Context160K
Q4_K_M142.5 GB
GGUF
LT
LTX2.3 10Eros 1.3
Ltx · chfm
Params21B
Context—
Q4_K_M14.3 GB
GGUF
GE
Fallen Gemma3 27B V1C
Gemma · TheDrummer
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
ST
Step 3.5 Flash REAP 149B A11B i1
Step · mradermacher
Params149B
Context256K
Q4_K_M89.9 GB
GGUF
LL
Bio Medical Llama 3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ER
Erk 14B
Erk · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF

Keep browsing