Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek V4.1 Flash 1017 abliterated MXFP4
DeepSeek · daemonix
Params485M
Context—
Smallest1.0 GB
GGUF
PH
dolphin 2 6 phi 2 candle
Phi · Demonthos
Params2.78B
Context—
Smallest1.6 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · khalifah66362666
Params1.86B
Context256K
Smallest0.9 GB
GGUF
LF
lfm2 colbert
Lfm · cstr
Params353M
Context—
Smallest0.0 GB
GGUF
ME
MedDecider 9B
Meddecider · lion-ai
Params9.2B
Context256K
Smallest0.2 GB
GGUF
MA
ML2 123B Magnum Diamond2 i1
Magnum · mradermacher
Params123B
Context128K
Smallest0.0 GB
GGUF
TE
Bonsai-27B
Ternary · vinpix
Params28.6B
Context256K
Smallest8.8 GB
GGUF
WA
K WALUAN
Waluan · wolffenbuetell
Params12.8B
Context—
Smallest14.6 GB
GGUF
FA
fabric llm finetune
Fabric · qvac
Params7M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 obliterated upstream
DeepSeek · HumanjavaEnterprises
Params748B
Context1024K
Smallest1.6 GB
GGUF
QW
ThinkingCap Qwen3.8 27B MixC
Qwen · Makdok
Params27.3B
Context256K
Smallest0.0 GB
GGUF
RO
RoadXpert AI v1 i1
Roadxpert · mradermacher
Params108B
Context256K
Smallest0.1 GB
GGUF
XL
CrystalCall v5 DCG
Xlam · DuoNeural
Params116M
Context512
Smallest0.1 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · buddalaw
Params755B
Context—
Smallest365.7 GB
GGUF
LL
NSFW RP RolePlay LoRA ArliAI Llama 3.1 8B
Llama · dslanger
Params42M
Context—
Smallest0.1 GB
GGUF
TE
Tals coder flash 02
Ternary · talxcc
Params28.9B
Context256K
Smallest8.3 GB
GGUF
GE
Gemma 4 Orthia 31B IQ4 XS
Gemma · mkzz127
Params32.1B
Context256K
Smallest0.0 GB
GGUF
MI
ministral uncensored
Mistral · virtuehearts
Params3.43B
Context32K
Q4_K_M2.1 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · tarruda
Params284B
Context1024K
Smallest0.5 GB
GGUF
CA
cat encoder
Cat · calcuis
Params2.61B
Context—
Smallest0.4 GB
GGUF
QW
PAW 27B
Qwen · lackonendes
Params5.62B
Context256K
Smallest7.8 GB
GGUF
GL
GLM 4.6 Derestricted i1
GLM · mradermacher
Params357B
Context198K
Smallest0.7 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 MXFP4
DeepSeek · kernelpool
Params485M
Context—
Smallest1.0 GB
GGUF
MI
Candle tiny mistral
Mistral · DanielClough
Params214M
Context—
Smallest0.1 GB
GGUF
RE
Researcher
Researcher · webAI-Official
Params65M
Context—
Smallest0.1 GB
GGUF
FU
fullstop punc multilang
Fullstop · cstr
Params559M
Context—
Smallest0.3 GB
GGUF
GR
granite vision crispembed
Granite · cstr
Params—
Context—
Smallest0.0 GB
GGUF
QW
qwen2.5 vl 3b crispembed
Qwen · cstr
Params3.75B
Context—
Smallest2.7 GB
GGUF
TE
Ternary-Bonsai-2-9B
Ternary · empyrealworks
Params9.2B
Context256K
Smallest2.3 GB
GGUF
MO
ai models
Models · cmginex
Params8.24B
Context—
Smallest8.8 GB
GGUF

Other uses

Keep browsing