GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Deepseek Coder 1.3b Base
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
EP
Epsilon Ocr D.Markdown Post3.0.M
Epsilon · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
HE
HelpingAI2 9B
Helpingai · mradermacher
Params8.9B
Context128K
Q4_K_M5.4 GB
Tool use
FA
Falcon-H1-34B-Instruct
Falcon · unsloth
Params33.6B
Context256K
Q4_K_M20.3 GB
Tool use
QW
Qwen2.5 Math 72B Instruct
Qwen · mradermacher
Params72.7B
Context4K
Q4_K_M47.4 GB
Tool use
DE
DeepSeek-V2-Lite-Chat
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · duyntnet
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
FL
FLUX.1 Fill dev
Flux · akikuli
Params11.9B
Context—
Smallest5.2 GB
GGUF
DA
Dark Oddity 12B v1.0
Dark · mradermacher
Params12B
Context128K
Q4_K_M7.3 GB
Roleplay
NE
nvidia.Nemotron Terminal 8B
Nemotron · DevQuasar
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
LF
LFM2-1.2B-Extract
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.8 GB
GGUF
NY
Nyanade Stunna Maid 7B i1
Nyanade · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
EXAONE 3.0 7.8B Instruct
Exaone · second-state
Params7.82B
Context4K
Q4_K_M4.8 GB
Coding
ST
StableLM 2 1.6B Chat
Stablelm · mradermacher
Params1.64B
Context4K
Q4_K_M1.0 GB
Tool use
QW
72B Qwen2.5 Kunou v1
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
Tool use
LF
LFM2 350M PII Extract JP
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
Tool use
LF
LFM2.5-1.2B-Base
Lfm · Mungert
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool use
KI
Kimi K3 IQ1S REAP568 64K 4XSPARKS
Kimi · 0xTank
Params1780B
Context1024K
Smallest398.5 GB
CodingReasoningTool use
MA
Magicoder DS 6.7B
Magicoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
DE
Deepseek Math 7b Base
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
MI
Mistral 2x22B MOE Power Codestral Ultimate 39B
Mistral · mradermacher
Params39.2B
Context32K
Q4_K_M23.6 GB
Coding
KU
Kunoichi-DPO-7B
Kunoichi · duyntnet
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
FL
FleetWorker E4B
Fleetworker · mradermacher
Params7.52B
Context64K
Q4_K_M5.3 GB
ReasoningTool useVision
MI
MioTTS 0.1B
Miotts · Aratako
Params114M
Context256K
Q4_K_M0.1 GB
GGUF
QW
Qwen1.5 22B Chat Merge
Qwen · mradermacher
Params22B
Context32K
Q4_K_M14.3 GB
GGUF
FL
flux.1 lite 8B alpha
Flux · city96
Params8.16B
Context—
Smallest3.7 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · gaianet
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
QW
Qwen3.8 Flash Next GSQ RCO Ko Coder
Qwen · attention-is-all-i-want
Params117B
Context256K
Smallest58.4 GB
CodingReasoningTool use
LL
Meta Llama 3 8B Instruct fictional Chinese v2
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Scarlett Llama 3 8B v1.0
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding

Keep browsing