Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
LE
lewm-pusht
Lewm · jepacpp
Params18M
Context—
Smallest0.0 GB
CH
checkpoint
Checkpoint · wiikoo
Params6.15B
Context—
Smallest12.3 GB
QW
Qwen3.5-122B-A10B
Qwen · eric717273
Params125B
Context256K
Smallest69.9 GB
FI
FireRed Image Edit 1.1 ComfyUI
Firered · cusiman
Params20.4B
Context—
Q4_K_M13.1 GB
YI
yiffInHell yihxxxTENDEDV20
Yiffinhell · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
NE
Nemotron 3.5 Bolt GameDev
Nemotron · dsfrdgttrtrshr
Params7.52B
Context64K
Smallest0.0 GB
ME
EpistemeAI metatune gpt20b R1.1
Metatune · bartowski
Params20.9B
Context128K
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731 Abliterated FP8 i1
DeepSeek · mradermacher
Params118M
Context—
Smallest0.5 GB
LL
testarchitect llama 3.2 3b it
Llama · hnkduy
Params3.21B
Context128K
Smallest6.4 GB
GE
Gemma 3N E4B Gutenberg v5
Gemma · jir88
Params38M
Context—
Smallest0.2 GB
QW
german ocr 2b
Qwen · Keyven
Params1.72B
Context256K
Smallest0.4 GB
UN
Kr3a
Unicuser · Unicuser
Params12.9B
Context—
Q4_K_M7.5 GB
CY
cypher 30b
Cypher · Dennis1315
Params54M
Context—
Smallest0.2 GB
SH
shuttle 3.1 aesthetic Aix
Shuttle · t8star
Params11.9B
Context—
Smallest6.9 GB
SO
Some Models
Some · meageropoulos
Params13B
Context—
Q4_K_M9.7 GB
CY
cyberdelia
Cyberdelia · 75dhsx2
Params11.9B
Context—
Smallest7.7 GB
DE
DeepSeek R1 GGUF MTP
DeepSeek · pdelobelle
Params12.5B
Context—
Smallest8.0 GB
LF
lfm2 350m modular loom
Lfm · loom-ai-org
Params355M
Context—
Smallest1.4 GB
QW
RecruitSheriff Qwen3 4B
Qwen · SomkeX
Params33M
Context—
Smallest0.1 GB
FA
Falcon3 7B Instruct 1.58bit
Falcon · nebuxcloud
Params7.46B
Context—
Smallest2.2 GB
SI
siglip2-base-naflex.f16
Siglip · eugenehp
Params375M
Context—
Smallest0.8 GB
NO
novaKemonoXL v20
Novakemonoxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
20
20q
david-ar
Params—
Context20
Smallest0.0 GB
AU
auraflow 0.3 quantized
Auraflow · marduk191
Params6.86B
Context—
Smallest2.4 GB
MI
MiniCPM5 1B
MiniCPM · EntityDeletr
Params1.08B
Context128K
Smallest0.0 GB
GE
aviai e4b
Gemma · wdenejko
Params7.46B
Context128K
Smallest0.1 GB
GE
Instinct Python Coder Gemma4 12B GLM5.2
Gemma · projectj
Params66M
Context—
Smallest0.1 GB
DE
DeepSeek V4 Flash 0731 REAP W
DeepSeek · mmnga-o
Params155B
Context1024K
Smallest55.0 GB
QW
nimbus 2 apex
Qwen · AhoosAI
Params87M
Context—
Smallest0.2 GB
AL
Alissonerdx
Alissonerdx · 75dhsx
Params16.4B
Context—
Smallest9.9 GB