Other GGUF models
4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.
TE
TetraNigga DUO 500K
Tetranigga · tetranigga
Params—
Context—
Smallest0.0 GB
QW
ToolChooser 0.8B
Qwen · Gramscii-IT
Params773M
Context256K
Smallest0.0 GB
QU
QUEST 35B RL A3B MXFP4 MOE Hybrid
Quest · jashepp
Params34.7B
Context256K
Smallest0.2 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · Stk88
Params284B
Context1024K
Smallest10.9 GB
MA
matsuolab weblab 10b
Matsuolab · mmnga
Params10.7B
Context—
Smallest6.0 GB
YU
YuE2 3B
Yue · Yuvraj18
Params3B
Context—
Q4_K_M2.3 GB
QW
Qwen2.5 3B SWE Agent QLoRA
Qwen · sMyn42
Params60M
Context—
Smallest0.1 GB
QW
Qwen3.6 27B Fusion 711 Uncensored MTP 48gb
Qwen · AlexanderKyng
Params3M
Context—
Smallest0.0 GB
DG
2DGS SLAM GGML
Dgs · Asher-1
Params689M
Context—
Smallest0.8 GB
SM
Lattice 3 Synapse 192M Poincare Instruct
SmolLM · DuoNeural
Params192M
Context512
Q4_K_M0.1 GB
TA
talk typer models
Talk · krocon
Params73M
Context—
Smallest0.0 GB
QW
Qwen3.6-27B-Uncensored-HauhauCS-Balanced
Qwen · BahamutRU
Params27.3B
Context256K
Smallest12.0 GB
RE
RedZFUN v6 ZIB Distilled AGILE 8steps
Redzfun · n0kovo
Params6.15B
Context—
Smallest5.0 GB
GO
Dark Goetia 26B A4B LoRA v3 B
Goetia · SubMaroon-exp
Params12M
Context—
Smallest0.0 GB
JE
jeff adapter emotion
Jeff · mstrasser
Params74M
Context—
Smallest0.2 GB
MO
MotionBricks G1 GGML
Motionbricks · chibifire
Params137M
Context—
Smallest0.0 GB
GR
granite 4.1 8b base
Granite · Anthonyg5005
Params8.38B
Context128K
Smallest0.0 GB
CA
calme v6 i1
Calme · mradermacher
Params78B
Context32K
Smallest0.0 GB
NE
Nemotron 3 Nano 30B A3B pirola IQ2 XXS XS
Nemotron · pirola
Params35.4B
Context1024K
Smallest0.1 GB
GL
GLM 4.5 Iceblink v2 106B A12B i1
GLM · mradermacher
Params110B
Context128K
Smallest0.2 GB
QW
QwenCare CN DPO v2 adapter F16
Qwen · jakwdir
Params44M
Context—
Smallest0.1 GB
TE
TetraNigga DUO 100K
Tetranigga · tetranigga
Params—
Context—
Smallest0.0 GB
GE
portuguese tutor lora gguf q8 0
Gemma · gd858
Params13M
Context—
Smallest0.0 GB
DE
DeepSeek V4 Flash 0731
DeepSeek · lyssquant
Params284B
Context1024K
Smallest10.9 GB
KA
Kandinsky 5.0 T2V Pro sft 5s Q4 K S
Kandinsky · Ada321
Params19.3B
Context—
Smallest14.3 GB
ET
ettin reranker 32m v1
Ettin · cstr
Params33M
Context—
Smallest0.0 GB
DE
DeepSeek V3.2 REAP 345B A37B GGUF Experimental
DeepSeek · lovedheart
Params344B
Context160K
Smallest0.5 GB
QW
OBLITERATUS Qwen3.8 27B OBLITERATED unsloth mlx
Qwen · nova-quill
Params3M
Context—
Smallest0.0 GB
OP
Ops-Colqwen3-4B
Ops · takenoko-gohan
Params4B
Context—
Q4_K_M3.3 GB
QW
intel mac local llm
Qwen · miutti
Params22.6B
Context256K
Smallest0.0 GB