Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-Flash-Next DS4 Q4 ple
Qwen · ivanfioravanti
Params51.2B
Context—
Smallest32.0 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · ggml-org
Params284B
Context—
Smallest10.8 GB
GGUF
GP
kldzj gpt oss 120b heretic v2
gpt-oss · bartowski
Params117B
Context—
Smallest0.2 GB
GGUF
SD
sdmodels
Sdmodels · MWSAH
Params11.9B
Context—
Smallest6.9 GB
GGUF
QW
Qwen3.8 27B
Qwen · batiai
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 heretic
DeepSeek · pqhaz
Params748B
Context1024K
Smallest457.0 GB
GGUF
BE
Beam 1.0 501B A23B
Beam · unsloth
Params501B
Context—
Smallest0.6 GB
GGUF
GR
Granite 4.0 H 1B BE
Granite · taronaeo
Params1.46B
Context—
Q4_K_M0.9 GB
GGUF
DE
DeepSeek V4 Flash Vision Exp Uncensored
DeepSeek · ddh0
Params284B
Context—
Smallest140.7 GB
GGUF
AN
Anima
Anima · Bedovyy
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF
MI
Ministral 3 8B Nymphaea RP
Mistral · 0xA50C1A1
Params8.49B
Context—
Smallest0.0 GB
GGUF
UN
unlimited ocr
Unlimited · vimalnakrani
Params2.93B
Context—
Q4_K_M2.0 GB
GGUF
MA
madlad400 3b mt
Madlad · jbochi
Params2.94B
Context—
Smallest1.0 GB
GGUF
QW
Qwen3.8 27B Velocity
Qwen · joycx
Params27.3B
Context—
Smallest0.0 GB
GGUF
GL
GLM 5.3 Flash Uncensored Mixed Quant
GLM · Baekpica
Params564M
Context—
Smallest1.1 GB
GGUF
MA
madlad400 10b mt
Madlad · google
Params10.7B
Context—
Smallest6.0 GB
GGUF
QW
Qwen3.8-27B GSQ-RCO
Qwen · Farggin
Params27.3B
Context256K
Smallest12.0 GB
GGUF
WA
WanT2IHighRealism2.2
Want · Kolso14
Params14.3B
Context—
Smallest15.4 GB
GGUF
DE
DeepSeek V4.1 Flash ik llama
DeepSeek · pokey2025
Params14.2B
Context—
Smallest7.9 GB
GGUF
UN
Unlimited OCR 2
Unlimited · RX5950XT
Params2.94B
Context128K
Q4_K_M2.2 GB
GGUF
QW
ATX Swift 1.5 Qwen3.8 27B Uncensored IQ4 XS M
Qwen · jakeatx
Params27.3B
Context256K
Smallest0.0 GB
GGUF
MI
MiMo V2.6 Pro MOPD
Mimo · AesSedai
Params1020B
Context—
Smallest3.1 GB
GGUF
MO
nightmare moss image
Moss · AbrahamPJ
Params5.08B
Context—
Smallest3.2 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · grainrigi
Params177B
Context256K
Smallest0.9 GB
GGUF
MI
Mistral Small 4 119B 2603 GGUF HALO
Mistral · Beinsezii
Params119B
Context—
Smallest0.1 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 dsx mxfp4
DeepSeek · lxe
Params—
Context—
Smallest270.5 GB
GGUF
LL
Llama 2 7b chat hf function calling v2
Llama · Trelis
Params7B
Context—
Smallest0.0 GB
GGUF
CO
Cosmos Predict2 14B Text2Image
Cosmos · city96
Params14.3B
Context—
Q4_K_M9.5 GB
GGUF
HI
HiDream O1 Image Dev
Hidream · smthem
Params8.8B
Context—
Smallest9.9 GB
GGUF
TI
tinyllama split test
Tinyllama · ngxson
Params24M
Context—
Smallest0.0 GB
GGUF

Other uses

Keep browsing