Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TO
topaz gregg shorthand 61m
Topaz · amongglue
Params63M
Context—
Smallest0.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 gollum
DeepSeek · BeriaLabs
Params748B
Context1024K
Smallest264.5 GB
GGUF
QW
Qwen3.6 35B A3B ROCMFP
Qwen · bakon3
Params48M
Context—
Smallest0.2 GB
GGUF
SN
snowflake arctic embed l v2.0 Q8A64
Snowflake · VelociQ8
Params865M
Context8K
Smallest0.9 GB
GGUF
ZG
ZGCM 1 7B
Zgcm · 0xtb
Params7.39B
Context256K
Smallest0.0 GB
GGUF
CO
comfyui
Comfyui · anonymoussechocolate
Params12.8B
Context—
Smallest5.0 GB
GGUF
GO
Goetia 26B A4B v1.4 LazyLora heresy
Goetia · MuXodious
Params25.2B
Context256K
Smallest0.1 GB
GGUF
BE
Behemoth X 123B v2 i1
Behemoth · mradermacher
Params123B
Context128K
Smallest0.0 GB
GGUF
OR
Ornith 1.0 9B MXFP4 Hybrid Imatrix
Ornith · jashepp
Params8.95B
Context256K
Smallest0.0 GB
GGUF
QW
Qwen3.6-27B-Uncensored-HauhauCS-Balanced
Qwen · crotron
Params27.3B
Context256K
Smallest12.0 GB
GGUF
LA
laya neutron
Laya · wigcheng5566
Params395M
Context8K
Smallest0.0 GB
GGUF
QW
Qwythos 9B v2 Q5 K L imat
Qwythos · DarkKitsune
Params9.2B
Context1024K
Smallest0.0 GB
GGUF
HI
HiggsTTS3
Higgstts · NeemaShioSe
Params4.65B
Context—
Smallest2.8 GB
GGUF
QW
Overbrilliant 27B Pro
Qwen · tashfene
Params27.3B
Context256K
Smallest0.2 GB
GGUF
LL
F2LLM v2 330M Q8 0
Llm · spelunk-cloud
Params334M
Context—
Smallest0.4 GB
GGUF
NE
Nemotron 3.5 Lightning 30B A3B pirola IQ3 XXS
Nemotron · pirola
Params36.9B
Context1024K
Smallest0.1 GB
GGUF
QW
Qwen2.1 REDQW21 UNLOCKED v2
Qwen · Fronyax
Params7.12B
Context—
Smallest4.2 GB
GGUF
QW
Overbrilliant 27B Air
Qwen · tashfene
Params26.9B
Context256K
Smallest0.2 GB
GGUF
PI
pixelhacker-places2-experimental-f32
Pixelhacker · cstr
Params862M
Context—
Smallest0.5 GB
GGUF
QW
NanoFlare v1
Qwen · MicroFlare
Params26.9B
Context256K
Smallest7.5 GB
GGUF
AN
anima
Anima · nopesadly
Params2.09B
Context—
Smallest1.2 GB
GGUF
IM
cyberrealistic zimage
Image · Solictous
Params6.15B
Context—
Smallest3.7 GB
GGUF
QW
Qwen3.8 27B Uncensored ROCMFPX MTP
Qwen · davenetdev
Params27.3B
Context256K
Smallest0.9 GB
GGUF
QW
Qwen3.5-122B-A10B
Qwen · jamiefutch
Params125B
Context256K
Smallest69.9 GB
GGUF
QW
Qwen3.8 27B Coder390
Qwen · HL1973
Params27.3B
Context256K
Smallest19.8 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Maya
DeepSeek · pp111asd
Params748B
Context1024K
Smallest276.6 GB
GGUF
GE
gemma 4 12B it SDFT Heretic LoRA
Gemma · Ilya626
Params5M
Context—
Smallest0.0 GB
GGUF
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · longlenai-team
Params284B
Context1024K
Smallest3.8 GB
GGUF
JO
joblib scanner bypass poc
Joblib · vellaveto
Params—
Context—
Smallest0.0 GB
GGUF
NE
Nemotron-3-Diarization
Nemotron · vibe-app
Params99M
Context—
Smallest0.1 GB
GGUF

Other uses

Keep browsing