Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
BE
beam reap 255b
Beam · nbKPS
Params255B
Context1024K
Smallest0.3 GB
GR
Granite 4.0 H Small BE
Granite · taronaeo
Params32.2B
Context1024K
Q4_K_M19.5 GB
QW
Qwen3.5 9B The Bradbury F451 Pro Writer Uncensored Heretic
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GE
gemma 4 E4B it
Gemma · eaddario
Params7.52B
Context128K
Smallest0.0 GB
CD
FC CDM Poincare 7L 108M
Cdm · DuoNeural
Params108M
Context512
Q4_K_M0.1 GB
QW
Qwen3.6 35B A3B GOLD APEX
Qwen · White-Wolf13
Params34.7B
Context256K
Smallest12.1 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · ATOMIKMN
Params1.86B
Context—
Smallest0.9 GB
MO
Model Compilation
Model · Coercer
Params14.3B
Context—
Q4_K_M9.7 GB
DE
DeepSeek V4 Flash
DeepSeek · ddh0
Params284B
Context1024K
Smallest3.8 GB
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · eaddario
Params22.5B
Context128K
Q4_K_M12.5 GB
MI
Luau Devstral 24B Instruct v0.2
Mistral · TorpedoSoftware
Params23.6B
Context128K
Smallest0.0 GB
GR
Granite Vision 3.3 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
QW
Qwen3.8 35B A3B Distill
Qwen · Atomic-Germ
Params35.5B
Context—
Smallest0.2 GB
DE
DeepSeek V4.1 Flash EXL3 3.0bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
GE
gemma 4 26B A4B it
Gemma · eaddario
Params25.2B
Context256K
Smallest0.1 GB
DE
DeepSeek V4.1 Flash MXFP4
DeepSeek · kernelpool
Params485M
Context—
Smallest1.0 GB
HO
holo
Holo · gguf-org
Params4.07B
Context—
Q4_K_M4.1 GB
DE
DeepSeek V4 Flash DSpark support
DeepSeek · sakamakismile
Params19.8B
Context—
Smallest6.0 GB
DE
YoungAi DeepSeek V4.1 Flash 1017
DeepSeek · wenzhouwu
Params485M
Context—
Smallest0.1 GB
TE
Ternary Bonsai 2 9B Uncensored LoRA
Ternary · AtomicChat
Params9B
Context—
Smallest0.0 GB
MI
minimax h3
Minimax · convertor
Params151M
Context—
Smallest0.3 GB
FI
FireRed Image Edit 1.0
Firered · vantagewithai
Params20.4B
Context—
Q4_K_M13.1 GB
ER
10Eros Max h3 TURBO hybrid beta3
Eros · electroglyph
Params20.1B
Context—
Smallest13.9 GB
CY
CyberRealistic Pony
Cyberrealistic · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
TI
tinyllamas BE
Tinyllamas · taronaeo
Params24M
Context—
Smallest0.0 GB
MO
moss image
Moss · gguf-org
Params5.08B
Context—
Smallest3.5 GB
QW
Qwen3.6 27B Ablit IQ4 XS
Qwen · sci4ai
Params26.9B
Context256K
Smallest0.0 GB
GR
Granite 4.2 8B BE
Granite · taronaeo
Params8.79B
Context128K
Q4_K_M5.3 GB
BO
Boogu Image Edit GGUFs
Boogu · realrebelai
Params10.3B
Context—
Smallest6.8 GB
IR
iris 3b
Iris · gguf-org
Params2.99B
Context—
Smallest2.5 GB