Other GGUF models

4481 GGUF models: GGUF models that are not language models and not clearly image or audio. Sizes run from 1M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
TetraNigga DUO 500K
Tetranigga · tetranigga
Params—
Context—
Smallest0.0 GB
GGUF
QW
ToolChooser 0.8B
Qwen · Gramscii-IT
Params773M
Context256K
Smallest0.0 GB
GGUF
QU
QUEST 35B RL A3B MXFP4 MOE Hybrid
Quest · jashepp
Params34.7B
Context256K
Smallest0.2 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · Stk88
Params284B
Context1024K
Smallest10.9 GB
GGUF
MA
matsuolab weblab 10b
Matsuolab · mmnga
Params10.7B
Context—
Smallest6.0 GB
GGUF
YU
YuE2 3B
Yue · Yuvraj18
Params3B
Context—
Q4_K_M2.3 GB
GGUF
QW
Qwen2.5 3B SWE Agent QLoRA
Qwen · sMyn42
Params60M
Context—
Smallest0.1 GB
GGUF
QW
Qwen3.6 27B Fusion 711 Uncensored MTP 48gb
Qwen · AlexanderKyng
Params3M
Context—
Smallest0.0 GB
GGUF
DG
2DGS SLAM GGML
Dgs · Asher-1
Params689M
Context—
Smallest0.8 GB
GGUF
SM
Lattice 3 Synapse 192M Poincare Instruct
SmolLM · DuoNeural
Params192M
Context512
Q4_K_M0.1 GB
GGUF
TA
talk typer models
Talk · krocon
Params73M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3.6-27B-Uncensored-HauhauCS-Balanced
Qwen · BahamutRU
Params27.3B
Context256K
Smallest12.0 GB
GGUF
RE
RedZFUN v6 ZIB Distilled AGILE 8steps
Redzfun · n0kovo
Params6.15B
Context—
Smallest5.0 GB
GGUF
GO
Dark Goetia 26B A4B LoRA v3 B
Goetia · SubMaroon-exp
Params12M
Context—
Smallest0.0 GB
GGUF
JE
jeff adapter emotion
Jeff · mstrasser
Params74M
Context—
Smallest0.2 GB
GGUF
MO
MotionBricks G1 GGML
Motionbricks · chibifire
Params137M
Context—
Smallest0.0 GB
GGUF
GR
granite 4.1 8b base
Granite · Anthonyg5005
Params8.38B
Context128K
Smallest0.0 GB
GGUF
CA
calme v6 i1
Calme · mradermacher
Params78B
Context32K
Smallest0.0 GB
GGUF
NE
Nemotron 3 Nano 30B A3B pirola IQ2 XXS XS
Nemotron · pirola
Params35.4B
Context1024K
Smallest0.1 GB
GGUF
GL
GLM 4.5 Iceblink v2 106B A12B i1
GLM · mradermacher
Params110B
Context128K
Smallest0.2 GB
GGUF
QW
QwenCare CN DPO v2 adapter F16
Qwen · jakwdir
Params44M
Context—
Smallest0.1 GB
GGUF
TE
TetraNigga DUO 100K
Tetranigga · tetranigga
Params—
Context—
Smallest0.0 GB
GGUF
GE
portuguese tutor lora gguf q8 0
Gemma · gd858
Params13M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V4 Flash 0731
DeepSeek · lyssquant
Params284B
Context1024K
Smallest10.9 GB
GGUF
KA
Kandinsky 5.0 T2V Pro sft 5s Q4 K S
Kandinsky · Ada321
Params19.3B
Context—
Smallest14.3 GB
GGUF
ET
ettin reranker 32m v1
Ettin · cstr
Params33M
Context—
Smallest0.0 GB
GGUF
DE
DeepSeek V3.2 REAP 345B A37B GGUF Experimental
DeepSeek · lovedheart
Params344B
Context160K
Smallest0.5 GB
GGUF
QW
OBLITERATUS Qwen3.8 27B OBLITERATED unsloth mlx
Qwen · nova-quill
Params3M
Context—
Smallest0.0 GB
GGUF
OP
Ops-Colqwen3-4B
Ops · takenoko-gohan
Params4B
Context—
Q4_K_M3.3 GB
GGUF
QW
intel mac local llm
Qwen · miutti
Params22.6B
Context256K
Smallest0.0 GB
GGUF

Other uses

Keep browsing