General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
OL
OLMo 2 1124 7B Instruct
OLMo · bartowski
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
SE
Seed OSS 36B Instruct Abliterated
Seed · mradermacher
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
MI
WikiHow Mistral Instruct 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Llama 3.2 3B Instruct Abliterated
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
DP
openaccess-ai-collective_dpopenhermes-7b-v2
Dpopenhermes · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
AI
Airoboros L2 13B 3.1.1
Airoboros · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama-3.1-Nemotron-Nano-8B-V1
Llama · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
AI
jondurbin_airoboros-m-7b-3.1.2
Airoboros · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
L3 8B Stheno v3.1
Stheno · QuantFactory
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
TE
Tencent Hy MT2 30B A3B
litigerking
Params30B
Context256K
Q4_K_M18.2 GB
GGUF
MA
Magnum 12b v2.5 Kto
Magnum · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
JA
Jais adapted 7B Reflection Tuning Natural Farmer i1
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
OR
Orion 26B A4B v1.1
Orion · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Security SLM Gemma 4 E2B it
Gemma · entrick
Params4.65B
Context128K
Q4_K_M3.4 GB
Tool use
RU
surogate rune 26b a4b
Rune · owao
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
DI
Diffusiongemma 26B A4B It HERETIC Uncensored
Diffusiongemma · yabaimimi
Params25.3B
Context256K
Q4_K_M16.8 GB
GGUF
MI
Mahou-1.3-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mia v2 29B
Mia · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
TE
Tenebra_30B_Alpha01_FP16
Tenebra · mradermacher
Params32.5B
Context16K
Q4_K_M19.6 GB
GGUF
QW
Qwen3 8B Heretic GGUF
Qwen · xFanexx
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
BE
BetterWright K2 Horizon 7B Uno
Betterwright · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
Tool use
GE
gemma-2-27b-it
Gemma · lmstudio-community
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
SA
Sakura SOLAR Instruct
Sakura · TheBloke
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Artemis 31B v1.1
Gemma · TheDrummer
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
AV
Avrik Lite 4B
Avrik · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
GGUF
CY
Cydonia 24B v4.3 Absolute Heresy
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
YI
Yi 1.5 34B Chat 16K
Yi · RichardErkhov
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
DO
weyaxi_dolphin2.1-openorca-7b
Dolphin · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama-2-7b-WikiChat-fused
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Other uses

Keep browsing