Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
EM
email-phishing-detector-v2 (DeBERTa-v3-base)
Email · andreilungeanu
Params—
Context—
Smallest0.3 GB
GGUF
FR
free splatter.cpp
Freesplatter · LocalAI-io
Params308M
Context—
Smallest0.6 GB
GGUF
IM
Z Image Turbo
Image · AaryanK
Params6.15B
Context—
Q4_K_M5.0 GB
GGUF
CO
command a 03 2025 uncut i1
Command · mradermacher
Params111B
Context128K
Smallest0.0 GB
GGUF
QW
Qwen 3.8 27B Uncensored
Qwen · jeuzu
Params27.3B
Context256K
Smallest31.5 GB
GGUF
NE
Nex N2.5 mini Mixed Q2Q3 128K
Nex · karmx
Params34.7B
Context256K
Smallest13.3 GB
GGUF
MI
Candle airoboros mistral2.2 7b
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
LL
Claude 3.5 Sonnet Distill Llama 3.2 1b Lora
Llama · darwin2025
Params11M
Context—
Smallest0.0 GB
GGUF
MI
mixtex zhen
Mixtex · cstr
Params86M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3 Embedding 0.6B Q8A64
Qwen · VelociQ8
Params621M
Context32K
Smallest0.6 GB
GGUF
HU
hy3d
Hunyuan · king5699
Params1.11B
Context—
Q4_K_M0.6 GB
GGUF
WA
Wan 2 safetensors pth
Wan · svjack
Params17.3B
Context—
Smallest13.9 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Uncensored
DeepSeek · suryatmodulus
Params115M
Context—
Smallest0.5 GB
GGUF
UN
Unlimited OCR
Unlimited · richardyoung
Params2.93B
Context32K
Q4_K_M2.0 GB
GGUF
OV
h2ovl mississippi 2b crispembed
Ovl · cstr
Params2.15B
Context—
Smallest0.1 GB
GGUF
GE
Geranium 105B v1.0.0 i1
Geranium · mradermacher
Params105B
Context128K
Smallest0.0 GB
GGUF
MO
Moxie GPU
Moxie · Moxiegen
Params27.3B
Context256K
Smallest0.0 GB
GGUF
AL
Alpha Model 1b 105B i1
Alpha · mradermacher
Params105B
Context128K
Smallest0.0 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · gshe-x2333
Params1.86B
Context256K
Smallest0.9 GB
GGUF
QW
qwen3loop 0.6b tool calling sft v38
Qwen · Lordnyx
Params1.04B
Context40K
Smallest1.1 GB
GGUF
BI
bitnet ternary moe
Bitnet · bong-water-water-bong
Params2.41B
Context4K
Smallest0.1 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP GGUF copy
Qwen · brianbellx
Params1.86B
Context—
Smallest0.9 GB
GGUF
MO
Mobile_Sam
Mobilesam · Acly
Params12M
Context—
Smallest0.0 GB
GGUF
PE
perfectionRealisticILXL 80
Perfectionrealisticilxl · WittyLee
Params12.8B
Context—
Smallest8.3 GB
GGUF
QW
Valen 4B
Qwen · Valen-Team
Params4.21B
Context256K
Smallest1.3 GB
GGUF
XL
CrystalCall v2 Poincare 7L 91M
Xlam · DuoNeural
Params91M
Context512
Smallest0.1 GB
GGUF
AN
Anima
Anima · applispee
Params2.09B
Context—
Q4_K_M1.4 GB
GGUF
MI
Candle dolphin 2.2.1 mistral 7b
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
QW
Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · KENIC-1
Params177B
Context256K
Smallest0.9 GB
GGUF
QW
MiMo-V2.6-Distill-Qwen-9B
Qwen · IHaveNoClueAndIMustPost
Params9.2B
Context256K
Smallest9.8 GB
GGUF

Other uses

Keep browsing