Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
Ternary Bonsai 2 27B Steered
Ternary · Secondchancee
Params27B
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731 REAP
DeepSeek · heath0xFF
Params180B
Context1024K
Q4_K_M109.0 GB
GGUF
DE
Huihui DeepSeek V4 Flash Vision Exp abliterated
DeepSeek · taurusduan
Params284B
Context—
Smallest135.3 GB
GGUF
AN
anima aesthetic v1.1
Anima · E-stick
Params2.09B
Context—
Smallest2.2 GB
GGUF
QW
Swift Qwen3.8 27B RCO
Qwen · ticeclock
Params27.3B
Context—
Smallest0.0 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · cc1244578151
Params177B
Context256K
Smallest0.9 GB
GGUF
MI
MiniCPM5 1B
MiniCPM · eaddario
Params1.08B
Context128K
Smallest0.0 GB
GGUF
QW
Qwen3.6 35B A3B SILVER APEX
Qwen · White-Wolf13
Params34.7B
Context256K
Smallest12.1 GB
GGUF
MO
MoCha
Mocha · vantagewithai
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
MI
Candle Mistral 7B Instruct v0.1
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
GGUF
SY
Synthia 70B
Synthia · TheBloke
Params69B
Context—
Q4_K_M41.4 GB
GGUF
MI
Candle llava v1.6 mistral 7b
Mistral · DanielClough
Params7.57B
Context—
Smallest2.5 GB
GGUF
GE
gemma 4 31B it qat heretic japanese imatrix
Gemma · OS-Software
Params30.7B
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek-OCR
DeepSeek · NexaAI
Params2.93B
Context—
Smallest1.7 GB
GGUF
QW
Qwen3.8 Flash Next abliterated GSQ RCO Strata
Qwen · QWER123951
Params—
Context—
Smallest0.0 GB
GGUF
MI
MiMo V2.6 Flash MOPD MXFP4
Mimo · kernelpool
Params310B
Context1024K
Smallest0.8 GB
GGUF
LF
lfm3 omni vl 2b 1rco 2mix
Lfm · efeisot
Params1.73B
Context125K
Smallest0.0 GB
GGUF
IM
Z Image Turbo Finetune GGUFs
Image · prolma
Params6.15B
Context—
Q4_K_M5.0 GB
GGUF
SO
SongGeneration v2 large
Songgeneration · smthem
Params5.12B
Context—
Smallest6.9 GB
GGUF
QW
Qwen3.8 27B Parasyte
Qwen · Plaguekind
Params27.3B
Context256K
Smallest23.0 GB
GGUF
DE
DeepSeek V4.1 Flash
DeepSeek · staccs
Params102B
Context1024K
Smallest99.1 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · Sica-Quants-1
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
MI
Mistral Large 4 1T A52B Uncensored
Mistral · AtomicChat
Params114M
Context—
Smallest0.5 GB
GGUF
QW
Qwopus3.5 9B Coder MTP
Qwopus · noctrex
Params1M
Context—
Smallest0.0 GB
GGUF
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · loscrossos
Params177B
Context256K
Smallest1.2 GB
GGUF
DE
DeepSeek V4.1 Flash DS4 IQ2
DeepSeek · ivanfioravanti
Params755B
Context—
Smallest1.0 GB
GGUF
FL
FLX BACKUP
Flx · wrongtarget
Params11.9B
Context—
Q4_K_M6.9 GB
GGUF
QW
Heretic Qwen3 VL 235B A22B Instruct i1
Qwen · mradermacher
Params235B
Context—
Smallest0.5 GB
GGUF
DE
Huihui DeepSeek V4 Flash 0731 abliterated
DeepSeek · CoreWolf
Params284B
Context1024K
Smallest10.9 GB
GGUF
QW
Lattice 7 Hermes CDM Poincare Instruct
Qwen · DuoNeural
Params437M
Context512
Smallest0.4 GB
GGUF

Other uses

Keep browsing