General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
BE
Bespoke-Nimble-9B-v3
Bespoke · ggml-org
Params8.95B
Context256K
Q4_K_M6.3 GB
GGUF
NE
Models Nvidia NVIDIA Nemotron Nano 12B v2
Nemotron · MaziyarPanahi
Params12.3B
Context1024K
Q4_K_M7.5 GB
GGUF
GE
gemma 4 26B A4B it uncensored
Gemma · TrevorJS
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
TI
Tinylaya For Testing
Tinylaya · ggml-org
Params90M
Context8K
Smallest0.1 GB
GGUF
LF
Lfm2.5-8B-A1B
Lfm · unsloth
Params8.47B
Context125K
Q4_K_M5.3 GB
GGUF
GL
GLM 5.3 UNCENSORED FP8
GLM · softwareweaver
Params753B
Context1024K
Q4_K_M454.6 GB
GGUF
QW
Abliterated MiMo V2.6 Distill Qwen 9B
Qwen · BoldingBuilds
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen2.5 Math 7B Instruct
Qwen · bartowski
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
MI
MiMo V2.6 Flash MOPD
Mimo · spiritfather
Params310B
Context1024K
Q4_K_M189.5 GB
GGUF
TE
Offrail 27B Uncensored
Ternary · sudoingx
Params28.6B
Context256K
Smallest6.3 GB
GGUF
GE
gemma 4 E2B it uncensored
Gemma · TrevorJS
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
QW
Qwen3 0.6B Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
FL
FLUX 3 Image Klein
Flux · AtomicChat
Params5.55B
Context256K
Smallest2.5 GB
GGUF
CE
MN 12B Celeste V1.9
Celeste · nothingiisreal
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GL
GLM-5.3-Flash
GLM · DogContext
Params321B
Context1024K
Smallest96.5 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · HuggingFaceTB
Params362M
Context8K
Smallest0.4 GB
GGUF
QW
Bahushruth Qwen3.6 35B A3B Abliterated v4
Qwen · Bahushruth
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
LI
Ling-3.0-tiny
Ling · inclusionAI
Params7.9B
Context128K
Q4_K_M4.8 GB
GGUF
QW
Qwen3 14B Abliterated Conservative
Qwen · richardyoung
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
Qwen3 Next 80B A3B Instruct
Qwen · bartowski
Params80B
Context256K
Q4_K_M48.7 GB
GGUF
NE
NVIDIA Nemotron 3 Nano 4B
Nemotron · nvidia
Params3.97B
Context1024K
Q4_K_M2.8 GB
Tool use
LL
testmod koen llama2 13b dpotrain testver
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
GGUF
QW
Qwen3 8B Abliterated
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
KI
Kimi Linear 48B A3B Instruct
Kimi · bartowski
Params49.1B
Context1024K
Q4_K_M30.1 GB
GGUF
QW
Huihui Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.6 35B A3b pruned v2
Qwen · gatilin
Params26.6B
Context256K
Smallest16.3 GB
GGUF
HU
Hunyuan MT 7B
Hunyuan · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
LL
Llama 3.3 70B Instruct
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Cyberneurova Qwen3.8 Flash Next
Qwen · spiritfather
Params177B
Context256K
Q4_K_M119.2 GB
GGUF

Other uses

Keep browsing