Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Selora AI LLM 1.7B
Qwen · selorahomes
Params2.03B
Context40K
Smallest0.0 GB
QW
Qwen3.6 35B A3B imatrix
Qwen · liodon-ai
Params34.7B
Context256K
Q4_K_M21.2 GB
OR
Ornith 1.5 35B A3B MXFP4
Ornith · tsaipifong
Params35.5B
Context—
Smallest0.4 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · KingKassell
Params1.86B
Context—
Smallest0.9 GB
WA
wan lora
Wan · kyledam
Params14.3B
Context—
Smallest15.4 GB
TE
Ternary Bonsai 2 27B Uncensored LoRA
Ternary · AtomicChat
Params2M
Context—
Smallest0.0 GB
SM
Lattice 4D Holographic 253M Poincare Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
DE
DeepSeek V4 Flash
DeepSeek · ggml-org
Params284B
Context—
Smallest4.7 GB
DE
DeepSeek V4.1 Flash DSpark
DeepSeek · JigSawPT
Params14.2B
Context—
Smallest8.0 GB
QW
Qwen3.8 27B Cold Fusion GAIN V1.1
Qwen · zerodigest
Params27.3B
Context256K
Smallest9.7 GB
UP
upass tm
Upass · rmaapk
Params—
Context—
Smallest0.0 GB
DE
DeepSeek V4.1 Flash UNCENSORED EXL3 2.9bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
QW
Qwen3.8 27B
Qwen · Brian6145
Params461M
Context—
Q4_K_M16.8 GB
FL
Florence 2 base
Florence · antflydb
Params232M
Context—
Smallest0.1 GB
BI
Hy MT1.5 1.8B 1.25bit
Bit · AngelSlim
Params1.79B
Context—
Smallest0.5 GB
TO
ToriiGate 0.5
Toriigate · SleepVeryHard
Params4.84B
Context—
Smallest0.0 GB
AN
AniSora v3
Anisora · woctordho
Params16.4B
Context—
Q4_K_M10.9 GB
CL
Cloudflare clef IQ3 S recovered
Clef · Joakimpalm-Zen
Params26.9B
Context256K
Smallest0.2 GB
OR
Ornith 1.5 122B IQ3 XXS 16G64G
Ornith · zephel01
Params125B
Context256K
Smallest0.4 GB
KR
krea2_raw
Krea · ChrisColeTech
Params12.8B
Context—
Q4_K_M7.2 GB
DE
DeepSeek V4.1 Flash
DeepSeek · Solstice-AI
Params748B
Context—
Q4_K_M444.7 GB
FI
FireRed Image Edit 1.0 ComfyUI
Firered · FireRedTeam
Params20.4B
Context—
Q4_K_M13.1 GB
CO
Comfyui
Comfyui · Herman172
Params14.3B
Context—
Smallest15.4 GB
BI
bitvla libero
Bitvla · vrfai
Params1.03B
Context—
Smallest1.4 GB
DE
DeepSeek V4 Flash MTP
DeepSeek · rogerai-fyi
Params291B
Context—
Smallest142.8 GB
SP
Spark X2.5 4B
Spark · eaddario
Params4.11B
Context—
Smallest0.0 GB
XL
pcs xlmr base
Xlm · cstr
Params278M
Context—
Smallest0.2 GB
DE
DeepSeek V4.1 Flash 1017 IQ2 XXS
DeepSeek · smalinin
Params748B
Context1024K
Smallest8.5 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Warumauchimmer
Params1.86B
Context—
Smallest0.9 GB
QW
Qwen3.5 9B The Deckard V8 Pro Writer Uncensored Heretic
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB