Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6 35B A3B
Qwen · eaddario
Params34.7B
Context—
Smallest0.4 GB
GGUF
QW
MiMo V2.6 Distill Qwen 9B
Qwen · VitreousCut
Params9.2B
Context256K
Q4_K_M6.1 GB
GGUF
SK
sketch
Sketch · calcuis
Params11.9B
Context—
Smallest4.0 GB
GGUF
TE
Bonsai 2 27B PTQ1 0 MTP Uncensored Ready
Ternary · ayshinko
Params2M
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 Sex
Qwen · ystemsrx
Params1.54B
Context—
Smallest3.1 GB
GGUF
SA
sam 3d body dinov3
Sam · LocalAI-io
Params841M
Context—
Smallest0.2 GB
GGUF
QW
voxprint huihui qwen36 27b
Qwen · Mitroshenkov87
Params27.3B
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017
DeepSeek · prometheusAIR
Params748B
Context1024K
Smallest0.8 GB
GGUF
M2
m2m100 418m
cstr
Params486M
Context—
Smallest0.3 GB
GGUF
DE
deepseek-ocr2
DeepSeek · cstr
Params3.39B
Context—
Smallest2.3 GB
GGUF
LC
lcm dreamshaper v7
Lcm · Steward
Params1.07B
Context—
Smallest2.1 GB
GGUF
KR
Krea2 Muse By Stable Yogi
Krea · ajsbsd
Params12.8B
Context—
Smallest8.3 GB
GGUF
PO
Pony Realism
Pony · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
SK
SkinTokens GGUF BF16
Skintokens · chibifire
Params29M
Context—
Smallest0.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Volta
DeepSeek · lxe
Params—
Context—
Smallest441.6 GB
GGUF
OM
omnigen2
Omnigen · calcuis
Params3.97B
Context—
Q4_K_M6.0 GB
GGUF
SP
SparkVSR
Sparkvsr · smthem
Params5.57B
Context—
Smallest7.9 GB
GGUF
CH
Chroma1 HD
Chroma · fairy322
Params8.9B
Context—
Q4_K_M5.6 GB
GGUF
QW
Qwen3.8 27B
Qwen · eaddario
Params27.3B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8 Flash Next APEX
Qwen · Atomic-Germ
Params177B
Context—
Smallest0.6 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP GGUF Q8 NVFP4
Qwen · AIconjured
Params1.86B
Context—
Smallest0.9 GB
GGUF
KI
moonshotai Kimi K2.6
Kimi · bartowski
Params1030B
Context256K
Smallest1.5 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · hardcoremoore
Params1.86B
Context—
Smallest0.9 GB
GGUF
GR
docling
Granite · gguf-org
Params258M
Context—
Q4_K_M0.5 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · LxBarn
Params1.86B
Context256K
Smallest0.9 GB
GGUF
DE
deepseek v4.1 flash gguf mirror
DeepSeek · hyukudan
Params755B
Context—
Smallest8.0 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B Badger Mixed
Qwen · CleverBadger
Params27.3B
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash DSpark draft
DeepSeek · YanissAmz
Params19.8B
Context—
Smallest10.9 GB
GGUF
QW
Selora AI LLM 14B
Qwen · selorahomes
Params14.8B
Context40K
Smallest0.0 GB
GGUF
QW
Qwen Image Pruning
Qwen · ThePun1sher
Params12.7B
Context—
Q4_K_M7.8 GB
GGUF

Other uses

Keep browsing