GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
models--google--gemma-7b-it
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MO
Morrow 2.6B
Morrow · mradermacher
Params2.57B
Context125K
Q4_K_M1.6 GB
GGUF
MI
Mira 1 Large 0919
Mira · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoningTool use
PL
PlanoO Zirelum
Planoo · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
LF
LFM2.5 8B A1B DSpark Draft v1
Lfm · magnitudedev
Params328M
Context125K
Smallest0.4 GB
ReasoningTool use
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · bottlecapai
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
OR
OrcaMaid 13B
Orcamaid · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · Nylonek
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
LL
Llama 3 5B Sheard
Llama · mradermacher
Params5.85B
Context8K
Q4_K_M3.6 GB
GGUF
CH
chronos 33b
Chronos · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
EX
EXAONE 3.0 7.8B Instruct
Exaone · bartowski
Params7.8B
Context4K
Q4_K_M4.8 GB
GGUF
CO
codegeex4-all-9b
Codegeex · bartowski
Params9.4B
Context128K
Q4_K_M6.3 GB
GGUF
HU
Hubble 4B V1C
Hubble · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
QW
Qwen3.8 Flash Next strixflash
Qwen · tawei-amd
Params177B
Context256K
Smallest2.8 GB
GGUF
EZ
Ezjev 4b S2
Ezjev · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
BA
bagel dpo 34b v0.5
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
CodingRoleplayTool use
SR
SRPO Refine Quantized v1.0
Srpo · wikeeyang
Params11.9B
Context—
Smallest7.7 GB
GGUF
LF
LFM2.5 1.2B Thinking heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningTool use
TE
migtissera_tess-m-v1.1
Tess · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen1.5 14B Chat
Qwen · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
CA
Captain Eris Violet V0.420 12B i1
Captain · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
LF
LFM2 1.2B Hi Fi
Lfm · fraQtl
Params1.17B
Context125K
Smallest0.7 GB
Tool use
LL
LLaMA2-13B-Holomax
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OR
Ornith 1.0 35B AEON Ultimate Uncensored
Ornith · vcruz305
Params34.7B
Context256K
Q4_K_M21.2 GB
Reasoning
MU
Muse Spark Open 816B A42B GGUF UltraOptimised Curated Protium
Muse · Solstice-AI
Params816B
Context—
Smallest0.8 GB
GGUF
KI
moonshotai Kimi K2.6
Kimi · bartowski
Params1030B
Context256K
Smallest1.5 GB
GGUF
LL
Llama 3.1 Hawkish 8B
Llama · bartowski
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
llama 3 bophades v2 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing