GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
DA
Dark Oddity 12B v1.0
Dark · ReadyArt
Params12B
Context128K
Q4_K_M7.3 GB
MI
grok oss 7B
Mistral · DeviantArtist031
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
openbuddy llama3.1 8b v22.2 131k i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
Mistral-7B-Holodeck-1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
LLaMA2-13B-Holomax
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
Llama 3 8B instruct dansk i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 72B
Qwen · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B 24GB LiLiCorr
Nemotron · magnitudedev
Params1.11B
Context256K
Smallest1.0 GB
LO
Loyal-Macaroni-Maid-7B
Loyal · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
Step 3.5 Flash APEX
Step · mudler
Params197B
Context256K
Smallest76.5 GB
HA
Hathor_Respawn-L3-8B-v0.8
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
NA
Nanbeige4.1 3B
Nanbeige · seanbailey518
Params3.93B
Context256K
Q4_K_M2.4 GB
LF
LFM2.5 VL 3B Heretic
Lfm · AX1Y2JP
Params2.7B
Context125K
Q4_K_M1.7 GB
FA
FastHunyuan
Fasthunyuan · city96
Params12.8B
Context—
Q4_K_M7.9 GB
KI
Kimi-K3
Kimi · 6block
Params2780B
Context1024K
Smallest540.4 GB
AN
Anthracite Core_Magnum v4 22b R4
Anthracite · anthracite-org
Params22.2B
Context32K
Q4_K_M13.3 GB
HU
Huihui LFM2.5 1.2B Instruct Abliterated
Huihui · mradermacher
Params1.17B
Context125K
Q4_K_M0.7 GB
ME
Medgemma 27b It
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
MY
MythoMax L2 13b
Mythomax · QuantFactory
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama3-8B-Instruct-Replete-Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
MiniMax M2.1 REAP 139B A10B i1
Minimax · mradermacher
Params139B
Context192K
Q4_K_M84.2 GB
SA
Satella-30B-A3B
Satella · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
BI
BigOrca 2 XB
Bigorca · mradermacher
Params22.5B
Context4K
Q4_K_M13.8 GB
SK
SkyReels V3 14B
Skyreels · vantagewithai
Params18.9B
Context—
Q4_K_M10.1 GB
MI
Mistral Small Gutenberg Doppel 22B i1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen2.5 Coder 3B Instruct Heretic
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwopus3.5 4B v3 MTP HF
Qwopus · Jackrong
Params4.33B
Context256K
Q4_K_M2.8 GB
WE
WestIceLemonTeaRP-32k-7b
Westicelemontearp · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB