General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
yeen214_llama2_7b_merge_orcafamily
Llama · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
SY
migtissera_synthia-7b-v1.5
Synthia · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
WizardMath 13B V1.0
Wizardmath · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
AA
aac board generator 770m ptbr
Aac · tardellirs
Params772M
Context32K
Q4_K_M0.6 GB
GGUF
QW
Qwen3.6 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
MI
nousresearch_yarn-mistral-7b-64k
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
Granite 3.3 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
RA
Radon 35B Ultra X RU
Radon · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
GGUF
MI
Mixtral 8x7B v0.1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
LU
Luban 13B
Luban · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HE
HelpingAI-9B
Helpingai · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
ST
Stheno Inverted L2 13B
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
NS
NSK 128k 7B slerp
Nsk · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
QW
qwen3 4b Z Image Engineer
Qwen · BennyDaBall
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
GP
Gpt Oss 20b Tainted Heresy
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
QW
Qwen3.8 Flash Next MTP
Qwen · dzannotti
Params3.88B
Context256K
Q4_K_M2.6 GB
GGUF
JA
japanese-novel-gpt-j-6b
Japanese · mmnga
Params6.05B
Context2K
Q4_K_M3.7 GB
GGUF
GP
openai community gpt2 GGUF smashed
Gpt · PrunaAI
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
MA
magnum v2 4b
Magnum · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
QW
gte-Qwen2-1.5B-instruct
Qwen · RichardErkhov
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
GE
rijgersberg_geitje-7b-chat
Geitje · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QQ
qqWen 32B Pretrain
Qqwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
HO
Holo4 27B
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
ST
StableBeluga 7B
Stablebeluga · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
OP
OpenChat 3.5 7B Starling v2.0
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
SU
SurgeGlobal OpenBezoar HH RLHF SFT
Surgeglobal · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
Tool use
LL
Llama-3-Patronus-Lynx-8B-Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
HI
openaccess-ai-collective_hippogriff-30b-chat
Hippogriff · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF

Other uses

Keep browsing