General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
DMind-3
gpt-oss · Mungert
Params20.9B
Context128K
Q4_K_M16.0 GB
GGUF
CO
c4ai-command-r-plus
Command R · BNK128
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
YI
brucethemoose_capybara-tess-yi-34b-200k
Yi · TheBloke
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
PH
migtissera Tess v2.5 Phi 3 medium 128k 14B
Phi · RichardErkhov
Params14B
Context128K
Q4_K_M8.6 GB
GGUF
SO
SOLAR 10.7B v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
NE
Nemotron 3 Super 120B A12B
Nemotron · bartowski
Params121B
Context1024K
Q4_K_M87.0 GB
GGUF
MI
Air Striker Mixtral 8x7B ZLoss Instruct i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
PS
PsyMedDestroyer i1
Psymeddestroyer · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
JA
Jan-Nano
Jan · unsloth
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
GL
Huihui GLM 4.7 Flash Abliterated 57B
GLM · mradermacher
Params55.6B
Context198K
Q4_K_M33.7 GB
GGUF
GP
GPT OSS Cybersecurity 20B Merged
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
QW
Winery Qwen3.8 Flash Next Cuvee
Qwen · WineryLabs
Params177B
Context256K
Smallest49.3 GB
GGUF
DA
DaringMaid 20B
Daringmaid · TheBloke
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
FA
Falcon-H1-0.5B-Instruct
Falcon · unsloth
Params521M
Context16K
Q4_K_M0.3 GB
GGUF
AU
Augmental Unholy 13B
Augmental · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
OP
openbuddy-zero-14b-v22.3-32k
Openbuddy · mradermacher
Params14B
Context32K
Q4_K_M8.4 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
YI
Yi-1.5-34B-32K
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
ST
StructLM-7B
Structlm · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
ausboss_llama-30b-supercot
Llama · TheBloke
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
QW
Qwen3.8 Flash Next MTP Q8 0
Qwen · agentionai
Params3.88B
Context256K
Smallest4.1 GB
GGUF
MI
Clinical BR Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
models--automerger--MeliodasM7-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
magnum v4 12b
Magnum · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
CA
CaptainErisNebula 12B Chimera v1.1
Captainerisnebula · Lewdiculous
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
DA
pocketdoc_dans-totsirocco-7b
Dans · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LU
LUNA SOLARkrautLM Instruct
Luna · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
OP
opus v1 34b i1
Opus · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · kingjones777
Params3.88B
Context256K
Q4_K_M2.8 GB
GGUF

Other uses

Keep browsing