Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
Chroma1 Radiance
Chroma · stduhpf
Params9.51B
Context—
Q4_K_M5.9 GB
GGUF
ZI
zimgturbo
Zimgturbo · wmueller
Params6.15B
Context—
Smallest6.5 GB
GGUF
TE
Ternary Bonsai 2 4B Uncensored LoRA
Ternary · AtomicChat
Params4B
Context—
Smallest0.0 GB
GGUF
AG
Agents A1 35B A3B MXFP4 MOE Hybrid Imatrix
Agents · jashepp
Params34.7B
Context256K
Smallest0.2 GB
GGUF
LI
Limite 1B Violetto
Limite · EmogheneAkpomedaye
Params1.07B
Context128K
Q4_K_M0.7 GB
GGUF
QW
Qwen3.8 Flash Next MTP Drafter
Qwen · ashbash
Params2.61B
Context—
Smallest1.9 GB
GGUF
QW
PAW 35B A3B
Qwen · lackonendes
Params4.19B
Context256K
Smallest7.9 GB
GGUF
PO
PornMaster
Pornmaster · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
GG
ggml clip vit base patch32
Ggml · mys
Params151M
Context—
Smallest0.0 GB
GGUF
MA
madlad400 7b mt bt
Madlad · jbochi
Params8.3B
Context—
Smallest4.7 GB
GGUF
DR
dreamshaper xl lightning
Dreamshaper · Solictous
Params3.47B
Context—
Smallest4.2 GB
GGUF
OP
opus-mt-he-de
Opus · cstr
Params77M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Genesis Hermes V7 GGUF MTP merge
Qwen · daanbanaan
Params34.7B
Context256K
Smallest0.9 GB
GGUF
QW
Qwen3.8 27B Defiance Uncensored MTP GGUF mirror
Qwen · EsteefAi
Params27.3B
Context256K
Smallest15.7 GB
GGUF
AY
aya 101
Aya · kcoopermiller
Params12.9B
Context—
Smallest4.2 GB
GGUF
DE
Sakura DeepSeek V4.1 Flash 1017 Maya XS Engram Q3 K
DeepSeek · webmp3
Params748B
Context1024K
Smallest199.8 GB
GGUF
MI
MiMo V2.6 Flash RL Uncensored Heretic LoRA
Mimo · MorinoNushi
Params35M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.8 27B chinese taste sft lora
Qwen · Moeblack
Params10M
Context—
Smallest0.0 GB
GGUF
QW
Clef LoRA for Qwen3.8 27B
Qwen · trevest
Params668M
Context—
Smallest1.3 GB
GGUF
SK
SkyReels V1 Hunyuan comfy
Skyreels · Kijai
Params12.8B
Context—
Smallest6.1 GB
GGUF
QW
Swift Qwen3.8 27B MIX
Qwen · vmarcelo
Params27.3B
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · bigfat
Params755B
Context—
Smallest365.7 GB
GGUF
GE
gemma 3 270m it loom
Gemma · loom-ai-org
Params268M
Context—
Smallest1.1 GB
GGUF
OR
Ornith 1.5 122B MXFP4
Ornith · tsaipifong
Params125B
Context256K
Smallest0.7 GB
GGUF
DE
DeepSeek-OCR
DeepSeek · NexaAI
Params2.93B
Context—
Smallest1.7 GB
GGUF
LF
LFM3 1.7B Base Q8A64
Lfm · VelociQ8
Params1.79B
Context—
Smallest1.8 GB
GGUF
CO
c4ai command r plus jlens
Command R · gghfez
Params9.51B
Context—
Smallest19.0 GB
GGUF
NE
NVIDIA Nemotron 3.5 Lightning 30B A3B ROCmFP4
Nemotron · julianmb
Params31.6B
Context256K
Smallest16.8 GB
GGUF
QW
Qwen2.5 7B Instruct BE
Qwen · taronaeo
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
DE
DSV4 Flash Vision Exp ablit DS4
DeepSeek · dicksondickson
Params466M
Context—
Smallest0.9 GB
GGUF

Other uses

Keep browsing