GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · gaianet
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
RU
RusMind 4.5.3 Momentum
Rusmind · DICPlay
Params4.65B
Context128K
Smallest9.3 GB
ReasoningTool use
MI
tosilos 128b
Mistral · nesilabs
Params125B
Context256K
Q4_K_M74.9 GB
ReasoningTool use
GR
Groot 65B A6B 261023
Groot · GrootTeam
Params117B
Context256K
Q4_K_M78.7 GB
ReasoningTool useVision
YI
mlinmg_sg-raccoon-yi-55b-200k
Yi · TheBloke
Params55.6B
Context195K
Q4_K_M33.3 GB
GGUF
TU
allenai_tulu-2-7b
Tulu · TheBloke
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
QW
Minecraftism 4B Uncensored
Qwen · mr-sus
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
QC
qCammel 13
Qcammel · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
vietnamese llama2 7B 40GB
Llama · TheBloke
Params6.86B
Context4K
Q4_K_M4.2 GB
GGUF
FA
falcon mamba 7b
Falcon · bartowski
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
MA
suayptalha Maestro 10B
Maestro · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
LF
LFM2.5 24B A2B abliterated mixed
Lfm · Jakevin
Params24B
Context128K
Smallest10.7 GB
GGUF
IN
Internlm2_5 1_8b Chat
InternLM · legraphista
Params1.89B
Context32K
Smallest0.5 GB
GGUF
QW
Qwen Image 2.1
Qwen · Supbatomic
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
WI
wizardlm_wizardmath-7b-v1.1
Wizardmath · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RU
RusMind 4.5 Vspyshka
Rusmind · DICPlay
Params7.52B
Context128K
Smallest15.1 GB
ReasoningTool use
QW
Qwen3.6 35B A3B heretic
Qwen · Abiray
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
AT
Athene V2 Chat
Athene · bartowski
Params73B
Context32K
Q4_K_M47.4 GB
GGUF
DE
Deepseek LLM 7B Chat
DeepSeek · second-state
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
LT
ltxv0.9.7
Ltx · calcuis
Params13B
Context—
Q4_K_M9.1 GB
GGUF
LL
ehartford_dolphin-llama-13b
Llama · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
DR
Drex v1.5
Drex · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
DE
DeepSeek V3 Bf16
DeepSeek · bullerwins
Params671B
Context160K
Q4_K_M404.4 GB
Tool use
MI
MiniMax M3.1 Flash StrixHalo
Minimax · Harsha001
Params313B
Context1024K
Smallest96.6 GB
ReasoningTool use
NE
Nemotron 3.5 Content Safety
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
BA
weyaxi_bagel-hermes-2x34b
Bagel · TheBloke
Params60.8B
Context195K
Q4_K_M36.7 GB
Tool use
BR
Breeze TTS 2
Breeze · Raxdiam
Params—
Context—
Smallest4.3 GB
GGUF
IN
Internlm2 Math Base 7b
InternLM · mradermacher
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
LL
Einstein v6.1 Llama3 8B
Llama · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
Tool use

Keep browsing