Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
RF
rfdetr cpp seg 2xlarge
Rfdetr · mudler
Params38M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 Coder Next code
Qwen · Voidstackloop
Params79.7B
Context256K
Smallest0.9 GB
GGUF
GE
Gemma 3 12b It
Gemma · eaddario
Params11.8B
Context128K
Q4_K_M6.2 GB
GGUF
DE
Huihui DeepSeek V4.1 Flash 1017 abliterated
DeepSeek · Ashwinxs
Params1.68B
Context1024K
Smallest0.6 GB
GGUF
RF
rfdetr cpp seg large
Rfdetr · mudler
Params35M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · vultr
Params284B
Context1024K
Smallest5.7 GB
GGUF
QW
Qwen3.8 27B GGUF 4.2BPW 16GB
Qwen · hitsfmdj
Params27.3B
Context256K
Smallest0.0 GB
GGUF
OP
open cabrita3b
Open · lucianosb
Params3.55B
Context—
Smallest2.1 GB
GGUF
FE
Fenrir X 26B A4B UD Q4 K XL
Fenrir · KaviarLabs
Params25.2B
Context256K
Smallest0.1 GB
GGUF
QW
TwinFlow Qwen Image v1.0 diffusers
Qwen · smthem
Params20.4B
Context—
Smallest9.0 GB
GGUF
LF
LFM2.5 24B A2B Heretic GSQ RCO
Lfm · lavendercomputing
Params24B
Context128K
Smallest0.1 GB
GGUF
QW
Qwen3.8 27B chinese taste lora
Qwen · Moeblack
Params638M
Context—
Smallest0.7 GB
GGUF
QW
qwen3 vl 2b crispembed
Qwen · cstr
Params10M
Context—
Smallest0.0 GB
GGUF
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · INSAIT-Institute
Params9.24B
Context8K
Q4_K_M0.0 GB
GGUF
TE
TestKrea
Testkrea · LoneWolfVPS
Params12.8B
Context—
Smallest8.3 GB
GGUF
NA
Nanbeige4.3 33B
Nanbeige · DogukanUrker
Params33.1B
Context512K
Smallest0.0 GB
GGUF
OR
Ornith 1.5 35B A3B REAP50
Ornith · Atomic-Germ
Params18.5B
Context256K
Smallest0.2 GB
GGUF
SR
SRPO
Srpo · befox
Params11.9B
Context—
Smallest4.0 GB
GGUF
OR
Ornith 1.5 397B GGUF imatrix
Ornith · cdanis
Params403B
Context256K
Smallest1.1 GB
GGUF
GP
gpt oss 160b kiwi i1
gpt-oss · mradermacher
Params160B
Context128K
Smallest0.2 GB
GGUF
CM
CMFUI
Cmfui · jmew1989
Params14.3B
Context—
Smallest15.4 GB
GGUF
QW
Qwen3.5 2B BE
Qwen · taronaeo
Params1.94B
Context256K
Q4_K_M1.3 GB
GGUF
QW
Qwen3.5 9B BE
Qwen · taronaeo
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP GGUF 6 bit
Qwen · LunarMoonar
Params1.86B
Context256K
Smallest0.9 GB
GGUF
QW
nerkyor Qwen3.8 27B EfficientThink KQVQ4 IQ3Floor 10G MTP Fast
Qwen · zhangrover
Params461M
Context256K
Smallest10.9 GB
GGUF
QW
Huihui v2 Qwen3.8 Flash Next GSQ RCO Strata abliterated direction
Qwen · Pragmatism0220
Params—
Context—
Smallest0.0 GB
GGUF
RF
rfdetr cpp seg small
Rfdetr · mudler
Params34M
Context—
Smallest0.0 GB
GGUF
HY
Hy3 NVFP4
Avifenesh
Params—
Context—
Smallest0.0 GB
GGUF
QW
nerkyor Qwen3.8 27B EfficientThink SimPO KQVQ4 IQ3Floor 10G MTP
Qwen · zhangrover
Params461M
Context256K
Smallest10.9 GB
GGUF
MI
Candle Mistral 7B OpenOrca
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF

Other uses

Keep browsing