Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
CH
Chroma1 Radiance
Chroma · stduhpf
Params9.51B
Context—
Q4_K_M5.9 GB
ZI
zimgturbo
Zimgturbo · wmueller
Params6.15B
Context—
Smallest6.5 GB
TE
Ternary Bonsai 2 4B Uncensored LoRA
Ternary · AtomicChat
Params4B
Context—
Smallest0.0 GB
AG
Agents A1 35B A3B MXFP4 MOE Hybrid Imatrix
Agents · jashepp
Params34.7B
Context256K
Smallest0.2 GB
LI
Limite 1B Violetto
Limite · EmogheneAkpomedaye
Params1.07B
Context128K
Q4_K_M0.7 GB
QW
Qwen3.8 Flash Next MTP Drafter
Qwen · ashbash
Params2.61B
Context—
Smallest1.9 GB
QW
PAW 35B A3B
Qwen · lackonendes
Params4.19B
Context256K
Smallest7.9 GB
PO
PornMaster
Pornmaster · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
GG
ggml clip vit base patch32
Ggml · mys
Params151M
Context—
Smallest0.0 GB
MA
madlad400 7b mt bt
Madlad · jbochi
Params8.3B
Context—
Smallest4.7 GB
DR
dreamshaper xl lightning
Dreamshaper · Solictous
Params3.47B
Context—
Smallest4.2 GB
OP
opus-mt-he-de
Opus · cstr
Params77M
Context—
Smallest0.1 GB
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes V7 GGUF MTP merge
Qwen · daanbanaan
Params34.7B
Context256K
Smallest0.9 GB
QW
Qwen3.8 27B Defiance Uncensored MTP GGUF mirror
Qwen · EsteefAi
Params27.3B
Context256K
Smallest15.7 GB
AY
aya 101
Aya · kcoopermiller
Params12.9B
Context—
Smallest4.2 GB
DE
Sakura DeepSeek V4.1 Flash 1017 Maya XS Engram Q3 K
DeepSeek · webmp3
Params748B
Context1024K
Smallest199.8 GB
MI
MiMo V2.6 Flash RL Uncensored Heretic LoRA
Mimo · MorinoNushi
Params35M
Context—
Smallest0.1 GB
QW
Qwen3.8 27B chinese taste sft lora
Qwen · Moeblack
Params10M
Context—
Smallest0.0 GB
QW
Clef LoRA for Qwen3.8 27B
Qwen · trevest
Params668M
Context—
Smallest1.3 GB
SK
SkyReels V1 Hunyuan comfy
Skyreels · Kijai
Params12.8B
Context—
Smallest6.1 GB
QW
Swift Qwen3.8 27B MIX
Qwen · vmarcelo
Params27.3B
Context—
Smallest0.0 GB
DE
DeepSeek V4.1 Flash
DeepSeek · bigfat
Params755B
Context—
Smallest365.7 GB
GE
gemma 3 270m it loom
Gemma · loom-ai-org
Params268M
Context—
Smallest1.1 GB
OR
Ornith 1.5 122B MXFP4
Ornith · tsaipifong
Params125B
Context256K
Smallest0.7 GB
DE
DeepSeek-OCR
DeepSeek · NexaAI
Params2.93B
Context—
Smallest1.7 GB
LF
LFM3 1.7B Base Q8A64
Lfm · VelociQ8
Params1.79B
Context—
Smallest1.8 GB
CO
c4ai command r plus jlens
Command R · gghfez
Params9.51B
Context—
Smallest19.0 GB
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B ROCmFP4
Nemotron · julianmb
Params31.6B
Context256K
Smallest16.8 GB
QW
Qwen2.5 7B Instruct BE
Qwen · taronaeo
Params7.62B
Context32K
Q4_K_M4.7 GB
DE
DSV4 Flash Vision Exp ablit DS4
DeepSeek · dicksondickson
Params466M
Context—
Smallest0.9 GB