General GGUF models

134659 GGUF models: general chat and instruction-following models. Sizes run from 0M to 20260731B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 Flash Next IQ2_XXS imatrix trunk, padded Q2_K down, MTP
Qwen · antirez
Params188B
Context256K
Smallest147.2 GB
GGUF
SU
Supra2 100M Instruct
Supra · SupraLabs
Params101M
Context2K
Smallest0.2 GB
GGUF
LF
LFM2.5 8B A1B
Lfm · LiquidAI
Params8.47B
Context125K
Q4_K_M5.2 GB
GGUF
QW
Qwen3 30B A3B
Qwen · Qwen
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
PH
Phi 4 Mini Instruct
Phi · bartowski
Params3.84B
Context128K
Q4_K_M2.5 GB
GGUF
LF
LFM2.5-350M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
GP
Openai_Gpt Oss 20b
gpt-oss · lmstudio-community
Params20.9B
Context128K
Smallest12.1 GB
GGUF
FL
FLUX.2 klein 4B
Flux · leejet
Params3.88B
Context—
Smallest2.5 GB
GGUF
GE
Gemma 4 26B A4B It Ultra Uncensored Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
gemma 2b
Gemma · google
Params2.51B
Context—
Smallest10.0 GB
GGUF
CP
CPH Community 7B
Cph · CypherTroopers
Params7B
Context—
Q4_K_M0.0 GB
GGUF
UN
Underdog Saluki 27B 1.0 MTP Abliterated
Underdog · Kujira
Params27.3B
Context256K
Smallest8.3 GB
Tool use
MI
Cydonia 24B v4.3
Mistral · TheDrummer
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
GE
Gemma 3 1b It
Gemma · lmstudio-community
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
BO
Bonsai-1.7B
Bonsai · prism-ml
Params1.72B
Context32K
Smallest0.2 GB
GGUF
QW
Qwen3 4B Instruct 2507
Qwen · lmstudio-community
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
FL
Recursive Flint
Flint · lmstudio-community
Params39.8B
Context256K
Q4_K_M24.2 GB
GGUF
DE
DeepSeek-V4-Pro-0813
DeepSeek · unsloth
Params1570B
Context1024K
Smallest849.7 GB
GGUF
GE
Gemma-3-270M-It
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
ME
Mellum2 12B A2.5B Instruct
Mellum · JetBrains
Params12.1B
Context128K
Q4_K_M8.1 GB
GGUF
HE
Hermes 4 14B
Hermes · bartowski
Params14.8B
Context40K
Q4_K_M9.0 GB
Tool use
BT
BTL 4 Compact
Btl · badtheorylabs
Params34.7B
Context256K
Smallest10.0 GB
Tool use
MU
Homura 30B
Muse · hyrelabs
Params28B
Context128K
Q4_K_M16.9 GB
Tool use
GE
Gemma 4 31B It Abliterated
Gemma · paperscarecrow
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
MO
MOSS-Music-8B
Moss · nerualdreming
Params8.19B
Context40K
Q4_K_M5.2 GB
GGUF
GR
Granite 4.0 1B BE
Granite · taronaeo
Params1.63B
Context—
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · lmstudio-community
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
GP
Gpt-Oss-120B
gpt-oss · unsloth
Params117B
Context128K
Q4_K_M62.8 GB
GGUF

Other uses

Keep browsing