Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8-27B
Qwen · bakhtin
Params27.3B
Context256K
Smallest16.7 GB
GGUF
SM
smolvla libero
Smolvla · fai-modelopt-tech
Params459M
Context—
Smallest0.9 GB
GGUF
DE
cyberneurova Deepseek v4 flash
DeepSeek · cyberneurova
Params284B
Context1024K
Smallest161.9 GB
GGUF
DE
HeatSeeker 284B A13B Lora
DeepSeek · UltimateIntent
Params826M
Context—
Smallest1.7 GB
GGUF
PE
personaplex 7b
Personaplex · forkjoin-ai
Params8.37B
Context—
Smallest4.7 GB
GGUF
GE
gemma 4 e4b lora selty
Gemma · mcvladoc
Params18M
Context—
Smallest0.0 GB
GGUF
LI
robotcpp pi0 libero finetuned v044
Libero · JJJYmmm
Params315M
Context—
Smallest0.0 GB
GGUF
QW
RaifuWars Warrior Qwen3VL 4B v2 LoRA
Qwen · yotisstudios
Params66M
Context—
Smallest0.1 GB
GGUF
SM
Smart Turn v3
Smart · empyrealworks
Params8M
Context—
Smallest0.0 GB
GGUF
TP
SD
Tppp · tppp2806
Params14.3B
Context—
Smallest9.7 GB
GGUF
ST
Step 3.5 Flash Midtrain GGUF by AesSedai
Step · Anayosky
Params197B
Context256K
Q4_K_M122.2 GB
GGUF
BA
LS2.5 108M A17M Base
Base · Dsg2
Params59M
Context—
Q4_K_M0.1 GB
GGUF
NE
NeuralPentest v5.1 Singularity GGU
Neuralpentest · sayanoxi
Params—
Context—
Smallest0.0 GB
GGUF
DE
deephat uncensored lora Q8 0
Deephat · Hahsksjsgs
Params10M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V2 Lite Adapter
DeepSeek · HongKiet
Params287M
Context—
Smallest0.6 GB
GGUF
LL
llama cpp ggml pad overflow poc
Llama · neimasilk
Params—
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 Next 80B A3B Instruct
Qwen · essigpeng
Params114M
Context—
Smallest0.5 GB
GGUF
MI
MiniMax M2 BF16 i1
Minimax · mradermacher
Params229B
Context192K
Smallest0.5 GB
GGUF
UL
UltraShape1.0 Quants
Ultrashape · Aero-Ex
Params3.05B
Context—
Smallest2.5 GB
GGUF
TE
ternary bonsai 1.7b decision lora
Ternary · ChezRD
Params70M
Context—
Smallest0.1 GB
GGUF
CH
poisoned
Chronos · jimb031
Params—
Context—
Smallest0.0 GB
GGUF
QW
eden 4b distilled lora
Qwen · FrostiSteele
Params21M
Context—
Smallest0.1 GB
GGUF
MA
madison text2img
Madison · Sashkanik13
Params1.07B
Context—
Smallest1.6 GB
GGUF
LL
Llama 3 Instruct Abliteration LoRA 8B
Llama · dimvasilk
Params88M
Context—
Smallest0.4 GB
GGUF
EM
M3
Emerald · Emerald7664
Params5.69B
Context10K
Q4_K_M2.1 GB
GGUF
QW
Qwen3 Embedding 0.6B 750 v1
Qwen · ENOSYS
Params596M
Context32K
Smallest0.0 GB
GGUF
SA
saathi lite preview
Saathi · krish99
Params1B
Context32K
Smallest0.0 GB
GGUF
TI
tinyllama 1.1b chat be
Tinyllama · librepowerai
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Qwen3.5 9B SOMPOA heresy
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF
QW
Qwen3.6 27B NVIDIA NVFP4 no MTP
Qwen · QQZ2026
Params26.9B
Context256K
Smallest15.5 GB
GGUF

Other uses

Keep browsing