Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
BO
prereleasetrainingpackage
Bonsai · ApacheOne
Params—
Context—
Smallest0.0 GB
GGUF
SK
skyfall dpo lora Q8 0
Skyfall · Gravelrat
Params125M
Context—
Smallest0.2 GB
GGUF
LI
lingbotvla
Lingbotvla · MoYoYoTech
Params2M
Context—
Smallest0.0 GB
GGUF
SM
smolvla-so101-multi-task
Smolvla · khanhnd61
Params403M
Context—
Smallest1.0 GB
GGUF
KR
krea2roras2
Krea · GeraldoZulimar
Params12.8B
Context—
Smallest0.3 GB
GGUF
QW
Qwen3 0.6B Particle SousVide R128 Perfect
Qwen · VoidWalkercero
Params600M
Context—
Smallest0.3 GB
GGUF
BG
bge base en v1.5
BGE · prithivida
Params109M
Context—
Smallest0.1 GB
GGUF
GE
Jacob 2 E4B
Gemma · jacob-ml
Params35M
Context—
Smallest0.1 GB
GGUF
SP
spam classifier liquid Q8 0
Spam · VoltageVagabond
Params6M
Context—
Smallest0.0 GB
GGUF
SA
sana cpp weights
Sana · doobluhc
Params4M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 8B Power
Qwen · librepowerai
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
AL
t0 alpha q4 0 webgpu
Alpha · idle-intelligence
Params102M
Context—
Smallest0.1 GB
GGUF
RF
rfdetr cpp seg medium
Rfdetr · adithya-balaji
Params35M
Context—
Smallest0.0 GB
GGUF
SB
sber gigaam v3
Sber · vokra
Params223M
Context—
Smallest0.4 GB
GGUF
GE
hiyori gemma4 12B qat gguf
Gemma · MelissaJ
Params262M
Context—
Smallest0.5 GB
GGUF
QW
sygnif lora v2
Qwen · gianson
Params29M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.6 27B KQVQ4 IQ3Floor 10G MTP
Qwen · zhangrover
Params461M
Context256K
Smallest10.9 GB
GGUF
VI
Vince AI
Vince · minyan250
Params11.9B
Context—
Smallest6.8 GB
GGUF
FL
candle flanUL2 quantized
Flan · pszemraj
Params19.5B
Context—
Smallest6.4 GB
GGUF
GP
gpt oss safeguard 120b i1
gpt-oss · mradermacher
Params40M
Context—
Smallest0.2 GB
GGUF
CO
comfyui public
Comfyui · chiangpei
Params7.12B
Context—
Q4_K_M2.0 GB
GGUF
QW
Qwen3 4b Roleplay Lora
Qwen · rockerBOO
Params6M
Context—
Smallest0.0 GB
GGUF
NO
novaFurryXL ilV155
Novafurryxl · Coercer
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
SA
sarvam 30b GGUF IQ2 S surgical
Sarvam · Aaravomega
Params32.2B
Context128K
Smallest0.2 GB
GGUF
TE
test gguf 1mkv
Test · angt
Params—
Context—
Smallest0.0 GB
GGUF
QW
Qwen Image Edit Rapid V4 relight
Qwen · sleziak
Params10B
Context—
Smallest3.5 GB
GGUF
QW
Qwen3.8 27B Q8Q6
Qwen · KENIC-1
Params27.3B
Context256K
Smallest0.9 GB
GGUF
ST
SteadyDancer 14B diffusers gguf dit
Steadydancer · smthem
Params16.4B
Context—
Smallest13.5 GB
GGUF
HU
hunyuan dating bundle
Hunyuan · Nikula8
Params11.9B
Context—
Smallest12.7 GB
GGUF
GE
gemma 3 270m vegan debate v1
Gemma · omkar9896
Params4M
Context—
Smallest0.0 GB
GGUF

Other uses

Keep browsing