Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4 Flash Strix Halo
DeepSeek · otheru
Params284B
Context1024K
Smallest10.9 GB
GGUF
MA
mageflow
Mage · gguf-org
Params4.12B
Context—
Smallest0.3 GB
GGUF
VO
vox jot models
Vox · IrieDinamik
Params4.43B
Context—
Q4_K_M2.9 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive Q6 K P
Qwen · leothebella
Params27.3B
Context256K
Smallest25.9 GB
GGUF
RA
raon-opentts-1b-f16
Raon · cstr
Params1.06B
Context—
Smallest2.8 GB
GGUF
QW
Qwen3 VL 8B Thinking
Qwen · NexaAI
Params8.19B
Context—
Smallest4.6 GB
GGUF
GE
gemma 4 31B it SDFT Heretic RP
Gemma · Ilya626
Params107M
Context—
Smallest0.2 GB
GGUF
OP
opus-mt-en-es
Opus · cstr
Params78M
Context—
Smallest0.1 GB
GGUF
QU
quant type
Quant · gguf-org
Params—
Context—
Q4_K_M0.0 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp
DeepSeek · vultr
Params284B
Context1024K
Smallest10.9 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp Q8 0 MXFP4 Q3 K Q2 K mixed
DeepSeek · BahamutRU
Params284B
Context1024K
Smallest128.0 GB
GGUF
FA
fabric llm finetune bitnet
Fabric · qvac
Params1.27B
Context2K
Smallest0.0 GB
GGUF
WO
Gryphe WorldSim Opus 3.6 35B A3B iQ compact APEX
Worldsim · Koshkasa
Params48M
Context—
Smallest0.2 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · minte1431
Params1.86B
Context256K
Smallest0.9 GB
GGUF
QW
Qwen3.8 27B Absolute Heresy LoRA
Qwen · MuXodious
Params69M
Context—
Smallest0.1 GB
GGUF
BG
bge m3 Q8A64
BGE · VelociQ8
Params865M
Context8K
Smallest0.9 GB
GGUF
MI
MiniMax M2 REAP 162B A10B i1
Minimax · mradermacher
Params162B
Context192K
Smallest0.3 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 GSQ RCO DSPARK
DeepSeek · neuralll
Params748B
Context1024K
Smallest4.9 GB
GGUF
LF
LFM2.5 8B A1B Opus Distil Q5 K M imat
Lfm · DarkKitsune
Params8.47B
Context125K
Smallest0.0 GB
GGUF
MI
Candle MistralTrix v1
Mistral · DanielClough
Params8.99B
Context—
Smallest2.9 GB
GGUF
GG
ggml CLIP ViT B 32 laion2B s34B b79K
Ggml · mys
Params151M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.6 27B
Qwen · zerodigest
Params27.3B
Context256K
Smallest10.0 GB
GGUF
LI
Ling flash 2.0 i1
Ling · mradermacher
Params103B
Context32K
Smallest0.3 GB
GGUF
SU
SuperDeepseek V4 Flash abliterated IK
Superdeepseek · KeinNiemand
Params284B
Context1024K
Smallest65.4 GB
GGUF
AL
all MiniLM L6 v2 BE
All · taronaeo
Params23M
Context512
Q4_K_M0.0 GB
GGUF
TE
Ternary Bonsai 2 2B Uncensored LoRA
Ternary · AtomicChat
Params2B
Context—
Smallest0.0 GB
GGUF
TE
textcht
Textcht · HuggingbaseHuggingbase
Params32.8B
Context256K
Smallest0.9 GB
GGUF
EM
embeddinggemma 2 ft typed decision
Embeddinggemma · cstr
Params272M
Context—
Smallest0.3 GB
GGUF
QW
Qwen 36 27
Qwen · havenoammo
Params425M
Context256K
Smallest0.5 GB
GGUF
TU
TURNA
Turna · helizac
Params1.14B
Context—
Smallest0.4 GB
GGUF

Other uses

Keep browsing