Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LE
lewm-pusht
Lewm · jepacpp
Params18M
Context—
Smallest0.0 GB
GGUF
CH
checkpoint
Checkpoint · wiikoo
Params6.15B
Context—
Smallest12.3 GB
GGUF
QW
Qwen3.5-122B-A10B
Qwen · eric717273
Params125B
Context256K
Smallest69.9 GB
GGUF
FI
FireRed Image Edit 1.1 ComfyUI
Firered · cusiman
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
YI
yiffInHell yihxxxTENDEDV20
Yiffinhell · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
NE
Nemotron 3.5 Bolt GameDev
Nemotron · dsfrdgttrtrshr
Params7.52B
Context64K
Smallest0.0 GB
GGUF
ME
EpistemeAI metatune gpt20b R1.1
Metatune · bartowski
Params20.9B
Context128K
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731 Abliterated FP8 i1
DeepSeek · mradermacher
Params118M
Context—
Smallest0.5 GB
GGUF
LL
testarchitect llama 3.2 3b it
Llama · hnkduy
Params3.21B
Context128K
Smallest6.4 GB
GGUF
GE
Gemma 3N E4B Gutenberg v5
Gemma · jir88
Params38M
Context—
Smallest0.2 GB
GGUF
QW
german ocr 2b
Qwen · Keyven
Params1.72B
Context256K
Smallest0.4 GB
GGUF
UN
Kr3a
Unicuser · Unicuser
Params12.9B
Context—
Q4_K_M7.5 GB
GGUF
CY
cypher 30b
Cypher · Dennis1315
Params54M
Context—
Smallest0.2 GB
GGUF
SH
shuttle 3.1 aesthetic Aix
Shuttle · t8star
Params11.9B
Context—
Smallest6.9 GB
GGUF
SO
Some Models
Some · meageropoulos
Params13B
Context—
Q4_K_M9.7 GB
GGUF
CY
cyberdelia
Cyberdelia · 75dhsx2
Params11.9B
Context—
Smallest7.7 GB
GGUF
DE
DeepSeek R1 GGUF MTP
DeepSeek · pdelobelle
Params12.5B
Context—
Smallest8.0 GB
GGUF
LF
lfm2 350m modular loom
Lfm · loom-ai-org
Params355M
Context—
Smallest1.4 GB
GGUF
QW
RecruitSheriff Qwen3 4B
Qwen · SomkeX
Params33M
Context—
Smallest0.1 GB
GGUF
FA
Falcon3 7B Instruct 1.58bit
Falcon · nebuxcloud
Params7.46B
Context—
Smallest2.2 GB
GGUF
SI
siglip2-base-naflex.f16
Siglip · eugenehp
Params375M
Context—
Smallest0.8 GB
GGUF
NO
novaKemonoXL v20
Novakemonoxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
20
20q
david-ar
Params—
Context20
Smallest0.0 GB
GGUF
AU
auraflow 0.3 quantized
Auraflow · marduk191
Params6.86B
Context—
Smallest2.4 GB
GGUF
MI
MiniCPM5 1B
MiniCPM · EntityDeletr
Params1.08B
Context128K
Smallest0.0 GB
GGUF
GE
aviai e4b
Gemma · wdenejko
Params7.46B
Context128K
Smallest0.1 GB
GGUF
GE
Instinct Python Coder Gemma4 12B GLM5.2
Gemma · projectj
Params66M
Context—
Smallest0.1 GB
GGUF
DE
DeepSeek V4 Flash 0731 REAP W
DeepSeek · mmnga-o
Params155B
Context1024K
Smallest55.0 GB
GGUF
QW
nimbus 2 apex
Qwen · AhoosAI
Params87M
Context—
Smallest0.2 GB
GGUF
AL
Alissonerdx
Alissonerdx · 75dhsx
Params16.4B
Context—
Smallest9.9 GB
GGUF

Other uses

Keep browsing