General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 8B
Qwen · lmstudio-community
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
QW
Qwen Image 2.1 PE T2I
Qwen · prithivMLmods
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
HE
Hemmingway 1
Hemmingway · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
GGUF
LF
Lfm2.5-1.2B-Instruct
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · bartowski
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · mlabonne
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 32B Abliterated
Qwen · RoadToNowhere
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · hugging-quants
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
QW
Sakura Qwen Image 2.1 Turbo Uncensored
Qwen · webmp3
Params7.12B
Context—
Q4_K_M4.1 GB
GGUF
QW
qwen2.5-14b-instruct
Qwen · Qwen
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
QW
Qwen2.5 14B Uncensored Instruct
Qwen · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
AC
xl_regrind_v1
Acestep · mdmachine
Params4.99B
Context32K
Q4_K_M3.0 GB
GGUF
QW
Qwen3.6 35B A3B DFlash
Qwen · jcuypers
Params474M
Context256K
Q4_K_M0.3 GB
GGUF
LL
Llama-3.3-70B-Instruct
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
MA
madlad400 3b mt
Madlad · google
Params2.94B
Context—
Smallest1.0 GB
GGUF
FB
fblgit juanako 7b UNA
Fblgit · RichardErkhov
Params7.24B
Context—
Q4_K_M0.0 GB
GGUF
QW
Qwen3 4b Z Image Turbo AbliteratedV1
Qwen · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
MI
mistralai_mistral-7b-instruct-v0.1
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Ternary Bonsai 2 27B PTQ1 0 MTP
Qwen · sudoingx
Params27.3B
Context256K
Smallest6.3 GB
GGUF
QW
Qwen3 8B
Qwen · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
LF
LFM2.5 2.6B GGUF shards
Lfm · Arki05
Params2.7B
Context128K
Smallest0.0 GB
GGUF
QW
Qwen3 14B
Qwen · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
TE
HY MT1.5 1.8B
Tencent · tencent
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
GE
gemma 2b fine tune
Gemma · arnavj007
Params2B
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 14B Abliterated
Qwen · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
CY
z image cyberrealistic v9
Cyberrealistic · gimly13
Params6.15B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Bonsai 2 27B Ternary CRACK
Qwen · dealignai
Params27B
Context256K
Smallest7.2 GB
GGUF
FL
FLUX.2 klein 9B
Flux · leejet
Params9.08B
Context—
Smallest5.6 GB
GGUF

Other uses

Keep browsing