General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
SH
Shisutemu Masuta Q3 32B
Shisutemu · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
DE
triadparty_deepmoney-34b-200k-chat-evaluator
Deepmoney · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
EX
models--automerger--Experiment26Mergerix-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PU
PuddleJumper 13B V2
Puddlejumper · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen2.5 14B
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
ET
Eternal.Bondange 3.2 1B
Eternal · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Tool use
HU
Huihui HY MT1.5 1.8B Abliterated
Huihui · mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
GGUF
MY
MysticFusion 13B
Mysticfusion · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.1 8B xLAM Agent
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 3.0 8b Lab Community
Granite · bartowski
Params8.17B
Context4K
Q4_K_M4.9 GB
GGUF
NE
abideen_nexonimbus-7b
Nexonimbus · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 34B 200K DARE Merge v7
Yi · RichardErkhov
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
ST
L3 SthenoMaidBlackroot 8B V1
Sthenomaidblackroot · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
TH
TheSpice-7b-FT-v0.3.1
Thespice · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 72B Instruct Malaysian
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
GA
Garryvik-0.1-7b-Linear
Garryvik · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS MXFP8 Engram
DeepSeek · Starw1
Params197B
Context1024K
Smallest138.6 GB
GGUF
LL
ShiningValiant 1.3
Llama · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
LL
PiSSA Llama 2 7b R128
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SU
ariellee_superplatty-30b
Superplatty · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LL
llama 2 7b chat sexed version5
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen3.8-Flash-Next GSQ-RCO
Qwen · shefowl
Params139B
Context256K
Smallest56.5 GB
GGUF
OP
Openbuddy Yi1.5 34b v21.3 32k
Openbuddy · RichardErkhov
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
JU
juanako 7b UNA i1
Juanako · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
UL
ultrareal-fine-tune.fp16.gguf
Ultrareal · void-gryph
Params11.9B
Context256
Q4_K_M6.7 GB
GGUF
TE
bonsai 2 27b mtp
Ternary · decent-jawfish
Params27.3B
Context256K
Smallest7.6 GB
GGUF
GE
gemma 4 26B A4B uncensored
Gemma · Riyan200324200324
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
SK
Skywork OR1 32B Preview
Skywork · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF

Other uses

Keep browsing