Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
BE
beam reap 255b
Beam · nbKPS
Params255B
Context1024K
Smallest0.3 GB
GGUF
GR
Granite 4.0 H Small BE
Granite · taronaeo
Params32.2B
Context1024K
Q4_K_M19.5 GB
GGUF
QW
Qwen3.5 9B The Bradbury F451 Pro Writer Uncensored Heretic
Qwen · nuofang
Params8.95B
Context256K
Smallest0.0 GB
GGUF
GE
gemma 4 E4B it
Gemma · eaddario
Params7.52B
Context128K
Smallest0.0 GB
GGUF
CD
FC CDM Poincare 7L 108M
Cdm · DuoNeural
Params108M
Context512
Q4_K_M0.1 GB
GGUF
QW
Qwen3.6 35B A3B GOLD APEX
Qwen · White-Wolf13
Params34.7B
Context256K
Smallest12.1 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · ATOMIKMN
Params1.86B
Context—
Smallest0.9 GB
GGUF
MO
Model Compilation
Model · Coercer
Params14.3B
Context—
Q4_K_M9.7 GB
GGUF
DE
DeepSeek V4 Flash
DeepSeek · ddh0
Params284B
Context1024K
Smallest3.8 GB
GGUF
MI
Mistral Small 3.2 24B Instruct 2506
Mistral · eaddario
Params22.5B
Context128K
Q4_K_M12.5 GB
GGUF
MI
Luau Devstral 24B Instruct v0.2
Mistral · TorpedoSoftware
Params23.6B
Context128K
Smallest0.0 GB
GGUF
GR
Granite Vision 3.3 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
QW
Qwen3.8 35B A3B Distill
Qwen · Atomic-Germ
Params35.5B
Context—
Smallest0.2 GB
GGUF
DE
DeepSeek V4.1 Flash EXL3 3.0bpw RANMA EXL3
DeepSeek · SaturnHeaven
Params552B
Context1024K
Smallest7.3 GB
GGUF
GE
gemma 4 26B A4B it
Gemma · eaddario
Params25.2B
Context256K
Smallest0.1 GB
GGUF
DE
DeepSeek V4.1 Flash MXFP4
DeepSeek · kernelpool
Params485M
Context—
Smallest1.0 GB
GGUF
HO
holo
Holo · gguf-org
Params4.07B
Context—
Q4_K_M4.1 GB
GGUF
DE
DeepSeek V4 Flash DSpark support
DeepSeek · sakamakismile
Params19.8B
Context—
Smallest6.0 GB
GGUF
DE
YoungAi DeepSeek V4.1 Flash 1017
DeepSeek · wenzhouwu
Params485M
Context—
Smallest0.1 GB
GGUF
TE
Ternary Bonsai 2 9B Uncensored LoRA
Ternary · AtomicChat
Params9B
Context—
Smallest0.0 GB
GGUF
MI
minimax h3
Minimax · convertor
Params151M
Context—
Smallest0.3 GB
GGUF
FI
FireRed Image Edit 1.0
Firered · vantagewithai
Params20.4B
Context—
Q4_K_M13.1 GB
GGUF
ER
10Eros Max h3 TURBO hybrid beta3
Eros · electroglyph
Params20.1B
Context—
Smallest13.9 GB
GGUF
CY
CyberRealistic Pony
Cyberrealistic · nuupy
Params2.57B
Context—
Q4_K_M1.6 GB
GGUF
TI
tinyllamas BE
Tinyllamas · taronaeo
Params24M
Context—
Smallest0.0 GB
GGUF
MO
moss image
Moss · gguf-org
Params5.08B
Context—
Smallest3.5 GB
GGUF
QW
Qwen3.6 27B Ablit IQ4 XS
Qwen · sci4ai
Params26.9B
Context256K
Smallest0.0 GB
GGUF
GR
Granite 4.2 8B BE
Granite · taronaeo
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
BO
Boogu Image Edit GGUFs
Boogu · realrebelai
Params10.3B
Context—
Smallest6.8 GB
GGUF
IR
iris 3b
Iris · gguf-org
Params2.99B
Context—
Smallest2.5 GB
GGUF

Other uses

Keep browsing