General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Hermes 2 Pro Llama 3.1 70B i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
LL
Vikhr-Llama-3.2-1B-instruct
Llama · Vikhrmodels
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MP
mpt 7b i1
Mpt · mradermacher
Params6.65B
Context2K
Q4_K_M4.3 GB
GGUF
QW
Qwen3.8 27B Cold Fusion GAIN V1.1 NVFP4
Qwen · esatapedico
Params27.3B
Context256K
Smallest14.9 GB
GGUF
SA
Salamandra 7b Instruct
Salamandra · RichardErkhov
Params7.77B
Context8K
Q4_K_M4.9 GB
GGUF
LF
LFM2 2.6B Exp
Lfm · LiquidAI
Params2.7B
Context125K
Q4_K_M1.6 GB
GGUF
GT
gte-large
Gte · opaninakuffo
Params334M
Context512
Smallest0.7 GB
GGUF
GE
Octopus-v2
Gemma · NexaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
Qwen3-32B-128K
Qwen · unsloth
Params32.8B
Context128K
Q4_K_M19.8 GB
GGUF
PR
prometheus 13B v1.0
Prometheus · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
CO
ContextualKunoichi KTO 7B i1
Contextualkunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Anubis 70B v1.2
Llama · TheDrummer
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
QW
Qwen2 0.5B NuminaMath TIR v1
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
LF
LFM2.5 8B A1B Uncensored
Lfm · zaakirio
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
ST
stabilityai japanese stablelm base beta 70b
Stabilityai · RichardErkhov
Params1.6B
Context—
Q4_K_M0.0 GB
GGUF
SK
Sky T1 32B Flash
Sky · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
ZE
zephyr 7b hh dpo i1
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AM
llm360_amber
Amber · TheBloke
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
LL
lightblue suzume llama 3 8B japanese
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite-4.0-Micro
Granite · unsloth
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
NO
nousresearch_nous-hermes-13b
Nous · TheBloke
Params13B
Context2K
Q4_K_M7.9 GB
Tool use
LL
OneLLM Doey V1 Llama 3.2 1B It
Llama · DoeyLLM
Params1.24B
Context128K
Smallest1.3 GB
GGUF
SE
ByteDance Seed_Seed OSS 36B Instruct
Seed · lmstudio-community
Params36.2B
Context512K
Q4_K_M21.8 GB
GGUF
EU
Euryale 1.4 L2 70B
Euryale · TheBloke
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3.8 Flash Next
Qwen · vcruz305
Params51.2B
Context256K
Q4_K_M2.8 GB
GGUF
SI
SIRI 7B High
Siri · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507
Qwen · second-state
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
GE
Gemma 4 E4B It OBLITERATED
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
QW
Qwen3.8 Flash Next MTP Strix Halo
Qwen · EasiiX
Params3.88B
Context256K
Smallest4.1 GB
GGUF
QW
Qwen3.5 9B Q4 K M
Qwen · Canfield
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF

Other uses

Keep browsing