GGUF models by lmstudio-community

432 GGUF models quantized by lmstudio-community on Hugging Face. Sizes run from 30M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM 4 32B 0414
GLM · lmstudio-community
Params32.6B
Context32K
Q4_K_M19.7 GB
Tool use
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B LiLiCorr
Nemotron · lmstudio-community
Params1.11B
Context256K
Smallest1.0 GB
ReasoningTool use
ST
Starling LM 7B beta
Starling · lmstudio-community
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Qwen2 500M Instruct
Qwen · lmstudio-community
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
CO
c4ai-command-r-v01
Command R · lmstudio-community
Params35B
Context128K
Q4_K_M21.5 GB
GGUF
LF
LFM2.5 2.6B
Lfm · lmstudio-community
Params2.7B
Context125K
Q4_K_M1.7 GB
ReasoningTool use
GE
Gemma 3 270m It
Gemma · lmstudio-community
Params268M
Context32K
Smallest0.2 GB
GGUF
GR
Ibm Granite_Granite 4.2 3b
Granite · lmstudio-community
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
IN
InternVL3_5 4B
Internvl · lmstudio-community
Params4.41B
Context40K
Q4_K_M2.7 GB
Vision
GL
GLM Z1 9B 0414
GLM · lmstudio-community
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
GR
Granite 3.1 1b A400M Instruct
Granite · lmstudio-community
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
MI
Mistral Large Instruct 2407
Mistral · lmstudio-community
Params123B
Context128K
Q4_K_M73.2 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · lmstudio-community
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
GR
Ibm Granite_Granite 4.2 30b
Granite · lmstudio-community
Params29.3B
Context128K
Q4_K_M17.7 GB
ReasoningTool use
QW
Qwen3 235B A22B
Qwen · lmstudio-community
Params235B
Context32K
Q4_K_M142.6 GB
ReasoningTool use
QW
Qwen2.5 Math 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context4K
Q4_K_M47.4 GB
Tool use
GE
Gemma 3 270m It
Gemma · lmstudio-community
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · lmstudio-community
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
AY
Aya Expanse 8b
Aya · lmstudio-community
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
LL
Meta-Llama-3-70B-Instruct
Llama · lmstudio-community
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
CO
Yi Coder 1.5B Chat
Coder · lmstudio-community
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
DE
DeepSeek V2.5
DeepSeek · lmstudio-community
Params236B
Context160K
Q4_K_M142.5 GB
Tool use
OR
Deepreinforce ai_Ornith 1.0 35B
Ornith · lmstudio-community
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
MI
mistralai_Devstral 2 123B Instruct 2512
Mistral · lmstudio-community
Params125B
Context256K
Q4_K_M74.9 GB
CodingTool use
LF
LiquidAI_LFM2.5 VL 1.6B
Lfm · lmstudio-community
Params1.17B
Context125K
Q4_K_M0.7 GB
Tool useVision
GP
gpt oss safeguard 120b
gpt-oss · lmstudio-community
Params117B
Context128K
Smallest63.4 GB
Tool use
YI
Yi-1.5-6B-Chat
Yi · lmstudio-community
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
LF
LFM2 VL 450M
Lfm · lmstudio-community
Params354M
Context125K
Q4_K_M0.2 GB
Vision
GL
GLM 4.5 Air
GLM · lmstudio-community
Params110B
Context128K
Q4_K_M73.5 GB
ReasoningTool use
IN
AlchemistCoder-DS-6.7B
InternLM · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding

Keep browsing