GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DA
Dark Oddity 12B v1.0
Dark · ReadyArt
Params12B
Context128K
Q4_K_M7.3 GB
Roleplay
MI
grok oss 7B
Mistral · DeviantArtist031
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
LL
openbuddy llama3.1 8b v22.2 131k i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Mistral-7B-Holodeck-1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
LL
LLaMA2-13B-Holomax
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
LL
Llama 3 8B instruct dansk i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B 24GB LiLiCorr
Nemotron · magnitudedev
Params1.11B
Context256K
Smallest1.0 GB
ReasoningTool use
LO
Loyal-Macaroni-Maid-7B
Loyal · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Step 3.5 Flash APEX
Step · mudler
Params197B
Context256K
Smallest76.5 GB
GGUF
HA
Hathor_Respawn-L3-8B-v0.8
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
NA
Nanbeige4.1 3B
Nanbeige · seanbailey518
Params3.93B
Context256K
Q4_K_M2.4 GB
ReasoningTool use
LF
LFM2.5 VL 3B Heretic
Lfm · AX1Y2JP
Params2.7B
Context125K
Q4_K_M1.7 GB
Vision
FA
FastHunyuan
Fasthunyuan · city96
Params12.8B
Context—
Q4_K_M7.9 GB
GGUF
KI
Kimi-K3
Kimi · 6block
Params2780B
Context1024K
Smallest540.4 GB
ReasoningTool useVision
AN
Anthracite Core_Magnum v4 22b R4
Anthracite · anthracite-org
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
HU
Huihui LFM2.5 1.2B Instruct Abliterated
Huihui · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
ME
Medgemma 27b It
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
EmbeddingVision
MY
MythoMax L2 13b
Mythomax · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama3-8B-Instruct-Replete-Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
MI
MiniMax M2.1 REAP 139B A10B i1
Minimax · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
ReasoningTool use
SA
Satella-30B-A3B
Satella · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
CodingReasoningTool use
BI
BigOrca 2 XB
Bigorca · mradermacher
Params22.5B
Context4K
Q4_K_M13.8 GB
GGUF
SK
SkyReels V3 14B
Skyreels · vantagewithai
Params18.9B
Context—
Q4_K_M10.1 GB
GGUF
MI
Mistral Small Gutenberg Doppel 22B i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct Heretic
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingRoleplay
QW
Qwopus3.5 4B v3 MTP HF
Qwopus · Jackrong
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool use
WE
WestIceLemonTeaRP-32k-7b
Westicelemontearp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing