Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
UN
unlimited ocr
Unlimited · forkjoin-ai
Params2.93B
Context32K
Q4_K_M2.0 GB
PA
PaddleOCR VL 1.6
Paddleocr · Pjiwm
Params921M
Context—
Smallest1.1 GB
MI
MiMo V2.6 Flash RL Uncensored Heretic LoRA
Mimo · 0xSojalSec
Params35M
Context—
Smallest0.1 GB
QW
Qwen3.8 27B
Qwen · ddh0
Params27.3B
Context256K
Smallest0.0 GB
QW
Ternary Bonsai 2 27B RTX4070
Qwen · trevor000
Params27.3B
Context256K
Q4_K_M7.5 GB
MA
madlad400 10b mt
Madlad · inferenceport-ai
Params10.7B
Context—
Smallest6.0 GB
FA
Falconsai/LightDec_Arthur/model.safetensors
Falcon · Falconsai
Params12M
Context—
Smallest0.0 GB
AN
Anima BaseV1.0
Anima · DaNS2025
Params2.09B
Context—
Smallest1.5 GB
VO
VoxCPM2
Voxcpm · novelaide
Params—
Context—
Smallest3.0 GB
TR
TriLM 1.5B TQ2 0
Trilm · librepowerai
Params1.52B
Context2K
Smallest0.5 GB
TE
testinglabsgen
Testinglabsgen · randomuserads
Params9.08B
Context—
Smallest6.9 GB
QW
Qwen3.8 27B F711 ColdGAIN Fable5Fusion MTP
Qwen · Verkiki
Params3M
Context—
Smallest0.0 GB
EC
EclecticEuphoria Project Chimera Frank fp16
Eclecticeuphoria · ND911
Params8.9B
Context—
Smallest6.3 GB
PR
Pristine 8B A1B MXFP4 MOE
Pristine · noctrex
Params8.34B
Context125K
Smallest0.0 GB
FL
FlixTest
Flixtest · HuggingbaseHuggingbase
Params7.12B
Context—
Smallest5.9 GB
TE
TetraNigga-ONE-1000P
Tetranigga · tetranigga
Params—
Context—
Smallest0.0 GB
LE
Legalllm
Legalllm · Sleem247
Params7M
Context—
Smallest0.0 GB
BO
Bonsai 4B requantized
Bonsai · lilyanatia
Params4.02B
Context32K
Smallest0.0 GB
RI
Rio 3.5 Open 397B
Rio · tarruda
Params396B
Context256K
Smallest1.1 GB
QW
qwen3.5 9b jspace abliterated
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
MI
ae
Mikaeltradera · MikaelTradera
Params11.9B
Context—
Smallest12.7 GB
JE
jeff adapter trading desk
Jeff · mstrasser
Params74M
Context—
Smallest0.2 GB
OR
Ornith 1.5 35B A3B ZeroFuse AD IQ3S IQ3XXS MTP
Ornith · l4zy0n3
Params447M
Context—
Smallest0.2 GB
SM
smolvla ducks
Smolvla · AIWintermuteAI
Params351M
Context—
Smallest0.7 GB
MI
mirror madlad400 3b mt
Mirror · NostraEmpire
Params2.94B
Context—
Smallest1.0 GB
DE
DeepSeek V4.1 Flash MXFP4 Q8 0 experimental
DeepSeek · mussonking
Params748B
Context1024K
Smallest508.0 GB
SM
Lattice 4 Nexus 253M Poincare Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
DE
DeepSeek V4.1 Flash 1017 GSQ 217 Strixolotl
DeepSeek · Snowsh1ne
Params14.2B
Context—
Smallest5.9 GB
GE
unsloth gemma 4 E2B it hierophant LoRA
Gemma · khimaros
Params—
Context—
Smallest0.0 GB
TE
TetraNigga-ONE-500P
Tetranigga · tetranigga
Params—
Context—
Smallest0.0 GB