Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
EP
epiCRealism SD15
Epicrealism · ygohel18
Params1.07B
Context—
Smallest1.6 GB
GGUF
GL
lid-fasttext-glotlid-v3
Glotlid · cstr
Params419M
Context—
Smallest0.2 GB
GGUF
RF
rfdetr cpp medium
Rfdetr · mudler
Params33M
Context—
Smallest0.0 GB
GGUF
GR
granite 4.1 8b
Granite · eaddario
Params8.79B
Context128K
Smallest0.0 GB
GGUF
MI
Timestral-209M
Mistral · EvoAwaken-Workshop
Params209M
Context—
Smallest0.8 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Abliteration LoRA
DeepSeek · BoldingBuilds
Params115M
Context—
Smallest0.5 GB
GGUF
DE
DeepSeek OCR 2
DeepSeek · SandLogicTechnologies
Params2.93B
Context8K
Smallest1.4 GB
GGUF
RF
rfdetr cpp seg medium
Rfdetr · mudler
Params35M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.8 27B UD IQ2 S
Qwen · agiws
Params26.9B
Context256K
Smallest0.0 GB
GGUF
OC
pp_ocrv6_tiny_rec
Ocrv · cstr
Params1M
Context—
Smallest0.0 GB
GGUF
QW
bubo qwen3.8 flash next
Qwen · HaloForgeLabs
Params2.31B
Context—
Smallest0.4 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Saviitt
Params1.86B
Context—
Smallest0.9 GB
GGUF
LO
lora2
Lora · mega281
Params14.3B
Context—
Smallest15.4 GB
GGUF
MI
MiniMax M2 REAP 139B A10B i1
Minimax · mradermacher
Params139B
Context192K
Smallest0.3 GB
GGUF
QW
Qwen3.6 35B A3B
Qwen · noctrex
Params35.5B
Context256K
Smallest21.2 GB
GGUF
UN
unlimited ocr 2 ru
Unlimited · p4ulbr4dl3y
Params2.94B
Context128K
Q4_K_M2.1 GB
GGUF
QW
unsloth Qwen3.5 122B A10B GGUF UD IQ4 XS GGUF SPLIT
Qwen · DanyDA
Params122B
Context256K
Smallest0.4 GB
GGUF
KI
Kimi K2.7 Code
Kimi · AesSedai
Params1030B
Context256K
Smallest1.5 GB
GGUF
QW
Qwen2.5 1.5B Instruct BE
Qwen · taronaeo
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 8B BE
DeepSeek · taronaeo
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GL
GLM 5.3 Flash GM CoT
GLM · cgg507
Params321B
Context1024K
Smallest138.9 GB
GGUF
DE
DeepSeek V4 Flash Base
DeepSeek · ReingeFallen
Params284B
Context1024K
Q4_K_M171.8 GB
GGUF
CH
Chroma1 Radiance
Chroma · silveroxides
Params9.51B
Context—
Smallest5.8 GB
GGUF
VO
Voxtral Mini 3B 2507
Voxtral · Bercraft
Params4.68B
Context—
Smallest1.6 GB
GGUF
QW
Qwen3.8 27B jacobian lens
Qwen · gghfez
Params1.65B
Context—
Smallest3.3 GB
GGUF
DE
deepseek v41 flash 1017 abliterated gguf public
DeepSeek · ktobik
Params748B
Context1024K
Smallest1.6 GB
GGUF
QW
EvilQwen control vectors
Qwen · dahara1
Params—
Context—
Smallest0.0 GB
GGUF
OP
opus-mt-en-de
Opus · cstr
Params75M
Context—
Smallest0.1 GB
GGUF
OP
opus-mt-ar-en
Opus · cstr
Params77M
Context—
Smallest0.1 GB
GGUF
QW
Lattice 5 Prometheus v2
Qwen · DuoNeural
Params406M
Context512
Smallest1.0 GB
GGUF

Other uses

Keep browsing