Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
TO
topaz gregg shorthand 61m
Topaz · amongglue
Params63M
Context—
Smallest0.1 GB
DE
DeepSeek V4.1 Flash 1017 gollum
DeepSeek · BeriaLabs
Params748B
Context1024K
Smallest264.5 GB
QW
Qwen3.6 35B A3B ROCMFP
Qwen · bakon3
Params48M
Context—
Smallest0.2 GB
SN
snowflake arctic embed l v2.0 Q8A64
Snowflake · VelociQ8
Params865M
Context8K
Smallest0.9 GB
ZG
ZGCM 1 7B
Zgcm · 0xtb
Params7.39B
Context256K
Smallest0.0 GB
CO
comfyui
Comfyui · anonymoussechocolate
Params12.8B
Context—
Smallest5.0 GB
GO
Goetia 26B A4B v1.4 LazyLora heresy
Goetia · MuXodious
Params25.2B
Context256K
Smallest0.1 GB
BE
Behemoth X 123B v2 i1
Behemoth · mradermacher
Params123B
Context128K
Smallest0.0 GB
OR
Ornith 1.0 9B MXFP4 Hybrid Imatrix
Ornith · jashepp
Params8.95B
Context256K
Smallest0.0 GB
QW
Qwen3.6-27B-Uncensored-HauhauCS-Balanced
Qwen · crotron
Params27.3B
Context256K
Smallest12.0 GB
LA
laya neutron
Laya · wigcheng5566
Params395M
Context8K
Smallest0.0 GB
QW
Qwythos 9B v2 Q5 K L imat
Qwythos · DarkKitsune
Params9.2B
Context1024K
Smallest0.0 GB
HI
HiggsTTS3
Higgstts · NeemaShioSe
Params4.65B
Context—
Smallest2.8 GB
QW
Overbrilliant 27B Pro
Qwen · tashfene
Params27.3B
Context256K
Smallest0.2 GB
LL
F2LLM v2 330M Q8 0
Llm · spelunk-cloud
Params334M
Context—
Smallest0.4 GB
NE
Nemotron 3.5 Lightning 30B A3B pirola IQ3 XXS
Nemotron · pirola
Params36.9B
Context1024K
Smallest0.1 GB
QW
Qwen2.1 REDQW21 UNLOCKED v2
Qwen · Fronyax
Params7.12B
Context—
Smallest4.2 GB
QW
Overbrilliant 27B Air
Qwen · tashfene
Params26.9B
Context256K
Smallest0.2 GB
PI
pixelhacker-places2-experimental-f32
Pixelhacker · cstr
Params862M
Context—
Smallest0.5 GB
QW
NanoFlare v1
Qwen · MicroFlare
Params26.9B
Context256K
Smallest7.5 GB
AN
anima
Anima · nopesadly
Params2.09B
Context—
Smallest1.2 GB
IM
cyberrealistic zimage
Image · Solictous
Params6.15B
Context—
Smallest3.7 GB
QW
Qwen3.8 27B Uncensored ROCMFPX MTP
Qwen · davenetdev
Params27.3B
Context256K
Smallest0.9 GB
QW
Qwen3.5-122B-A10B
Qwen · jamiefutch
Params125B
Context256K
Smallest69.9 GB
QW
Qwen3.8 27B Coder390
Qwen · HL1973
Params27.3B
Context256K
Smallest19.8 GB
DE
DeepSeek V4.1 Flash 1017 Maya
DeepSeek · pp111asd
Params748B
Context1024K
Smallest276.6 GB
GE
gemma 4 12B it SDFT Heretic LoRA
Gemma · Ilya626
Params5M
Context—
Smallest0.0 GB
DE
Huihui DeepSeek V4 Flash abliterated ds4
DeepSeek · longlenai-team
Params284B
Context1024K
Smallest3.8 GB
JO
joblib scanner bypass poc
Joblib · vellaveto
Params—
Context—
Smallest0.0 GB
NE
Nemotron-3-Diarization
Nemotron · vibe-app
Params99M
Context—
Smallest0.1 GB