GGUF models: other license

14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CA
calme-3.2-instruct-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
GGUF
DE
deepseek-coder-6.7b-instruct
DeepSeek · godolike
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
CO
codec.cpp
Codec · BricksDisplay
Params74M
Context—
Q4_K_M0.1 GB
GGUF
EX
EXAONE 4.0.1 32B
Exaone · bartowski
Params32B
Context128K
Q4_K_M19.3 GB
GGUF
SO
SOLAR-10.7B-Instruct-v1.0
Solar · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama 4 Scout 17B 16E Instruct 4bit
Llama · glogwa68
Params17B
Context9766K
Q4_K_M22.5 GB
GGUF
RU
RusMind Malysh 4.7
Rusmind · DICPlay
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
ST
Step 3.5 Flash REAP 121B A11B i1
Step · mradermacher
Params121B
Context256K
Q4_K_M72.8 GB
ReasoningTool use
MY
MythoMax-L2-13b
Mythomax · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NE
Nekomata 7b
Nekomata · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
NE
Ternary Nemotron 3.5 Lightning 30B A3B
Nemotron · boro64
Params31.6B
Context1024K
Smallest9.5 GB
ReasoningTool use
KR
Krutrim 2 Instruct
Krutrim · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
ReasoningTool use
LL
Llama 13b
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
DA
Steelskull L3.3 Damascus R1
Damascus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
BI
BigQwen2.5 Echo 47B Instruct
Bigqwen · bartowski
Params47.4B
Context32K
Q4_K_M28.6 GB
GGUF
ER
Eris PrimeV3 Vision 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
RoleplayVision
IN
Yi-Ko-34B-Instruct
Instruct · mradermacher
Params34.6B
Context4K
Q4_K_M20.8 GB
GGUF
PF
pfnet nekomata 14b pfn qfin
Pfnet · mmnga
Params14.2B
Context8K
Q4_K_M9.4 GB
GGUF
OP
OpenELM 3B
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
GGUF
LL
Meta-Llama-3-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3-8B-Stheno-v3.1
Stheno · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 Coder 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
HA
Hathor_Stable-L3-8B-v0.5
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
D1
d1 3B
prithivMLmods
Params2.7B
Context32K
Q4_K_M1.7 GB
ReasoningTool useVision
TI
Tiamat 7b 1.1 Dpo
Tiamat · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
MS Meadowlark 22B
Meadowlark · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
GGUF
NE
NeuralDaredevil-8B-abliterated
Neuraldaredevil · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
EC
EchoSwift 700M
Echoswift · mradermacher
Params742M
Context125K
Q4_K_M0.5 GB
Tool use
LF
LFM2.5 VL 3B DSpark
Lfm · LiquidAI
Params279M
Context125K
Smallest0.6 GB
Vision

Keep browsing