General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral Nemo 12B ArliAI RPMax v1.2
Mistral · ArliAI
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
NE
Neuralgamma 2.5 7B slerp
Neuralgamma · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Tool use
QW
Qwen3.8 4B Agentic Distill
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
LL
Firefly Llama2 13B v1.2
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
FR
FrogNano 4B 2609
Frognano · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
ED
EduMixtral 4x7B i1
Edumixtral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
RW
rwkv 6 finch 14b
Rwkv · latestissue
Params14.1B
Context1024K
Smallest5.4 GB
GGUF
DE
Deepseek-Tng-R1T2-Chimera
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M404.9 GB
GGUF
VI
Vikhr Nemo 12B Instruct R 21 09 24
Vikhr · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Mahou-1.2a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YU
Yuan2 M32 hf IMat
Yuan · legraphista
Params40.2B
Context4K
Smallest8.7 GB
GGUF
FA
Falcon Mamba 7b Instruct
Falcon · tiiuae
Params7.27B
Context1024K
Q4_K_M4.2 GB
GGUF
QW
14B Qwen2.5 Kunou v1
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
LL
Llama 2 13B Ensemble v6
Llama · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HE
HERO 4B
Hero · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
NU
NuExtract v1.5
Nuextract · lmstudio-community
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
MP
Mpt 30b Instruct
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · gaianet
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
IN
Index Nailong 9B
Index · IndexTeam
Params8.95B
Context224K
Q4_K_M5.6 GB
GGUF
MI
fpham_autolycus-mistral_7b
Mistral · TheBloke
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NO
Nous Puffin 70B i1
Nous · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
NA
NaNovel 35B A3B
Nanovel · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
VI
bofenghuang_vigogne-2-7b-instruct
Vigogne · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MA
MagpieLM 8B Chat v0.1 i1
Magpielm · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
CH
Chocolatine 3B Instruct DPO Revised Q4 K M
Chocolatine · jpacifico
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
LL
nvidia Llama 3 3 Nemotron Super 49B v1
Llama · bartowski
Params49.9B
Context128K
Q4_K_M30.2 GB
GGUF
SW
Swallow MS 7b Instruct v0.1
Swallow · RichardErkhov
Params7.33B
Context4K
Q4_K_M4.4 GB
GGUF
WI
winter garden 7b alpha
Winter · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Llama-3-8B-Instruct-MopeyMule
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
GGUF

Other uses

Keep browsing