Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
GR
Groot 280B A16B 261023
Groot · GrootTeam
Params477B
Context1024K
Smallest8.5 GB
MI
candle mistral
Mistral · lmz
Params7.24B
Context—
Smallest4.1 GB
XI
Xiaomi OCR 0 Paretrix
Xiaomi · Soulfate24
Params752M
Context256K
Smallest0.0 GB
AN
Anything LCM
Anything · mzwing
Params1.07B
Context—
Smallest1.6 GB
ST
starvector-1b-im2svg-full
Starvector · oxide-lab
Params1B
Context—
Smallest0.8 GB
GR
Granite 3.1 2B Instruct BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
DE
DeepSeek V4 Flash Vision EXP abliterated lora
DeepSeek · Sabomako
Params1.31B
Context—
Smallest1.4 GB
GK
GKD
Gkd · Asher-1
Params151M
Context—
Smallest0.3 GB
BO
Merousis 26B A4B
Boulesis · lithinnon
Params14M
Context—
Smallest0.1 GB
DE
DeepSeek V4 Flash 0731 DSpark
DeepSeek · Lucebox
Params19.8B
Context—
Smallest10.6 GB
OR
Ornith 1.5 35B A3B Q3K Q4K8 emb8 16.9GB
Ornith · dgaretz
Params34.7B
Context256K
Smallest16.9 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · datamart99
Params1.86B
Context—
Smallest0.9 GB
CA
Candle SOLAR 10.7B v1.0
Candle · DanielClough
Params10.7B
Context—
Smallest3.5 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP GGUF q4kp
Qwen · lstari
Params1.86B
Context256K
Smallest0.9 GB
QW
Qwen3 VL 32B MiniMax H3
Qwen · Raretutor
Params25.8B
Context—
Smallest8.5 GB
FO
ppformulanet-l-ocr
Formulanet · cstr
Params181M
Context—
Smallest0.1 GB
BI
BindWeave
Bindweave · vantagewithai
Params16.4B
Context—
Q4_K_M10.9 GB
IN
inkling jlens
Inkling · gghfez
Params2.45B
Context—
Smallest4.9 GB
HO
Holo 3.1 35B A3B MTP
Holo · gbuzhf
Params447M
Context—
Smallest0.2 GB
MI
Candle Nous Hermes 2 Mistral 7B DPO
Mistral · DanielClough
Params7.24B
Context—
Smallest2.4 GB
QW
Lattice 6 Prometheus v2 HeptaCap
Qwen · DuoNeural
Params406M
Context512
Smallest0.3 GB
QW
Qwen3.8 27B Uncensored Cyber agent
Qwen · 0xSojalSec
Params3M
Context—
Smallest0.0 GB
OP
opus-mt-de-ar
Opus · cstr
Params77M
Context—
Smallest0.1 GB
DE
DeepSeek V4.1 Flash 1017 UNCENSORED Q8 0
DeepSeek · Adolphsson
Params748B
Context1024K
Smallest508.0 GB
UN
unlimited-ocr-2
Unlimited · cstr
Params3.34B
Context—
Smallest3.6 GB
OP
opus-mt-ar-de
Opus · cstr
Params77M
Context—
Smallest0.1 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · cvgro
Params1.86B
Context256K
Smallest0.9 GB
DE
DeepSeek V4.1 Flash 1017 GSQ RCO
DeepSeek · kigimues
Params197B
Context—
Smallest110.6 GB
DE
DeepSeek V4 Flash 0731 RANMA EXL3
DeepSeek · SaturnHeaven
Params285B
Context1024K
Smallest110.0 GB
BT
bttr-handwritten-math-ocr
Bttr · cstr
Params7M
Context—
Smallest0.0 GB