GGUF models: other license
14270 GGUF models listed under the other license on Hugging Face. Always read the license text before commercial use. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
CA
calme-3.2-instruct-78b
Calme · bartowski
Params78B
Context32K
Q4_K_M50.7 GB
DE
deepseek-coder-6.7b-instruct
DeepSeek · godolike
Params6.74B
Context16K
Q4_K_M4.1 GB
CO
codec.cpp
Codec · BricksDisplay
Params74M
Context—
Q4_K_M0.1 GB
EX
EXAONE 4.0.1 32B
Exaone · bartowski
Params32B
Context128K
Q4_K_M19.3 GB
SO
SOLAR-10.7B-Instruct-v1.0
Solar · duyntnet
Params10.7B
Context4K
Q4_K_M6.5 GB
LL
Llama 4 Scout 17B 16E Instruct 4bit
Llama · glogwa68
Params17B
Context9766K
Q4_K_M22.5 GB
RU
RusMind Malysh 4.7
Rusmind · DICPlay
Params752M
Context256K
Q4_K_M0.5 GB
ST
Step 3.5 Flash REAP 121B A11B i1
Step · mradermacher
Params121B
Context256K
Q4_K_M72.8 GB
MY
MythoMax-L2-13b
Mythomax · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
NE
Nekomata 7b
Nekomata · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
NE
Ternary Nemotron 3.5 Lightning 30B A3B
Nemotron · boro64
Params31.6B
Context1024K
Smallest9.5 GB
KR
Krutrim 2 Instruct
Krutrim · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
NE
ThinkingCap NVIDIA Nemotron 3.5 Lightning 30B A3B
Nemotron · mradermacher
Params32.9B
Context1024K
Q4_K_M25.4 GB
LL
Llama 13b
Llama · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
DA
Steelskull L3.3 Damascus R1
Damascus · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
BI
BigQwen2.5 Echo 47B Instruct
Bigqwen · bartowski
Params47.4B
Context32K
Q4_K_M28.6 GB
ER
Eris PrimeV3 Vision 7B GGUF IQ Imatrix
Eris · Lewdiculous
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
Yi-Ko-34B-Instruct
Instruct · mradermacher
Params34.6B
Context4K
Q4_K_M20.8 GB
PF
pfnet nekomata 14b pfn qfin
Pfnet · mmnga
Params14.2B
Context8K
Q4_K_M9.4 GB
OP
OpenELM 3B
Openelm · RichardErkhov
Params3.04B
Context2K
Q4_K_M1.9 GB
LL
Meta-Llama-3-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
ST
L3-8B-Stheno-v3.1
Stheno · duyntnet
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 Coder 3B
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
HA
Hathor_Stable-L3-8B-v0.5
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
D1
d1 3B
prithivMLmods
Params2.7B
Context32K
Q4_K_M1.7 GB
TI
Tiamat 7b 1.1 Dpo
Tiamat · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
MS Meadowlark 22B
Meadowlark · bartowski
Params22.2B
Context128K
Q4_K_M13.3 GB
NE
NeuralDaredevil-8B-abliterated
Neuraldaredevil · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
EC
EchoSwift 700M
Echoswift · mradermacher
Params742M
Context125K
Q4_K_M0.5 GB
LF
LFM2.5 VL 3B DSpark
Lfm · LiquidAI
Params279M
Context125K
Smallest0.6 GB