Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
UN
unlimited ocr
Unlimited · forkjoin-ai
Params2.93B
Context32K
Q4_K_M2.0 GB
GGUF
PA
PaddleOCR VL 1.6
Paddleocr · Pjiwm
Params921M
Context—
Smallest1.1 GB
GGUF
MI
MiMo V2.6 Flash RL Uncensored Heretic LoRA
Mimo · 0xSojalSec
Params35M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.8 27B
Qwen · ddh0
Params27.3B
Context256K
Smallest0.0 GB
GGUF
QW
Ternary Bonsai 2 27B RTX4070
Qwen · trevor000
Params27.3B
Context256K
Q4_K_M7.5 GB
GGUF
MA
madlad400 10b mt
Madlad · inferenceport-ai
Params10.7B
Context—
Smallest6.0 GB
GGUF
FA
Falconsai/LightDec_Arthur/model.safetensors
Falcon · Falconsai
Params12M
Context—
Smallest0.0 GB
GGUF
AN
Anima BaseV1.0
Anima · DaNS2025
Params2.09B
Context—
Smallest1.5 GB
GGUF
VO
VoxCPM2
Voxcpm · novelaide
Params—
Context—
Smallest3.0 GB
GGUF
TR
TriLM 1.5B TQ2 0
Trilm · librepowerai
Params1.52B
Context2K
Smallest0.5 GB
GGUF
TE
testinglabsgen
Testinglabsgen · randomuserads
Params9.08B
Context—
Smallest6.9 GB
GGUF
QW
Qwen3.8 27B F711 ColdGAIN Fable5Fusion MTP
Qwen · Verkiki
Params3M
Context—
Smallest0.0 GB
GGUF
EC
EclecticEuphoria Project Chimera Frank fp16
Eclecticeuphoria · ND911
Params8.9B
Context—
Smallest6.3 GB
GGUF
PR
Pristine 8B A1B MXFP4 MOE
Pristine · noctrex
Params8.34B
Context125K
Smallest0.0 GB
GGUF
FL
FlixTest
Flixtest · HuggingbaseHuggingbase
Params7.12B
Context—
Smallest5.9 GB
GGUF
TE
TetraNigga-ONE-1000P
Tetranigga · tetranigga
Params—
Context—
Smallest0.0 GB
GGUF
LE
Legalllm
Legalllm · Sleem247
Params7M
Context—
Smallest0.0 GB
GGUF
BO
Bonsai 4B requantized
Bonsai · lilyanatia
Params4.02B
Context32K
Smallest0.0 GB
GGUF
RI
Rio 3.5 Open 397B
Rio · tarruda
Params396B
Context256K
Smallest1.1 GB
GGUF
QW
qwen3.5 9b jspace abliterated
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF
MI
ae
Mikaeltradera · MikaelTradera
Params11.9B
Context—
Smallest12.7 GB
GGUF
JE
jeff adapter trading desk
Jeff · mstrasser
Params74M
Context—
Smallest0.2 GB
GGUF
OR
Ornith 1.5 35B A3B ZeroFuse AD IQ3S IQ3XXS MTP
Ornith · l4zy0n3
Params447M
Context—
Smallest0.2 GB
GGUF
SM
smolvla ducks
Smolvla · AIWintermuteAI
Params351M
Context—
Smallest0.7 GB
GGUF
MI
mirror madlad400 3b mt
Mirror · NostraEmpire
Params2.94B
Context—
Smallest1.0 GB
GGUF
DE
DeepSeek V4.1 Flash MXFP4 Q8 0 experimental
DeepSeek · mussonking
Params748B
Context1024K
Smallest508.0 GB
GGUF
SM
Lattice 4 Nexus 253M Poincare Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 GSQ 217 Strixolotl
DeepSeek · Snowsh1ne
Params14.2B
Context—
Smallest5.9 GB
GGUF
GE
unsloth gemma 4 E2B it hierophant LoRA
Gemma · khimaros
Params—
Context—
Smallest0.0 GB
GGUF
TE
TetraNigga-ONE-500P
Tetranigga · tetranigga
Params—
Context—
Smallest0.0 GB
GGUF

Other uses

Keep browsing