GGUF models by lmstudio-community

432 GGUF models quantized by lmstudio-community on Hugging Face. Sizes run from 30M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
codegemma-1.1-7b-it
Codegemma · lmstudio-community
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
QW
Qwen2.5 Math 1.5B Instruct
Qwen · lmstudio-community
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
MI
mistralai_Devstral Small 2505
Mistral · lmstudio-community
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
CO
codegemma-7b-it
Codegemma · lmstudio-community
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LL
CodeLlama-7B-KStack
Llama · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
Qwen_Qwen3 VL 30B A3B Thinking
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool useVision
CO
codegemma-2b
Codegemma · lmstudio-community
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Mistral-Small-4-119B-2603
Mistral · lmstudio-community
Params119B
Context1024K
Q4_K_M72.2 GB
Vision
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · lmstudio-community
Params236B
Context160K
Q4_K_M142.5 GB
CodingTool use
PH
Phi 3.1 mini 128k instruct
Phi · lmstudio-community
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
ME
Google_Medgemma 4b It
Medgemma · lmstudio-community
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
LA
poolside_Laguna XS 2.1
Laguna · lmstudio-community
Params33.4B
Context256K
Q4_K_M20.3 GB
ReasoningTool use
MI
Magistral Small 2506
Mistral · lmstudio-community
Params23.6B
Context48K
Q4_K_M14.3 GB
Reasoning
CO
Yi Coder 9B Chat
Coder · lmstudio-community
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
WI
WizardLM-2-7B
Wizardlm · lmstudio-community
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
CodeLlama-7B-KStack-clean
Llama · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
GR
Granite Vision 3.2 2b
Granite · lmstudio-community
Params2.53B
Context16K
Q4_K_M1.5 GB
Tool useVision
SM
HuggingFaceTB_SmolLM3 3B
SmolLM · lmstudio-community
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
ZE
zeta
Zeta · lmstudio-community
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GR
Ibm Granite_Granite 4.0 Micro
Granite · lmstudio-community
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
MI
Pixtral
Mistral · lmstudio-community
Params12.2B
Context1000K
Q4_K_M7.5 GB
Vision
QW
Qwen_Qwen3 VL 32B Thinking
Qwen · lmstudio-community
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningTool useVision
IN
InternLM2
InternLM · lmstudio-community
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
GE
gemma-1.1-2b-it
Gemma · lmstudio-community
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GR
Ibm Granite_Granite 4.1 3b
Granite · lmstudio-community
Params3.4B
Context128K
Q4_K_M2.1 GB
Tool use
QW
Qwen_Qwen3 30B A3B Thinking 2507
Qwen · lmstudio-community
Params30.5B
Context256K
Q4_K_M18.6 GB
ReasoningTool use
NE
NVIDIA Nemotron 3.5 Bolt E4B DFlash
Nemotron · lmstudio-community
Params360M
Context128K
Smallest0.7 GB
ReasoningTool use
MI
MiniCPM O 2_6
MiniCPM · lmstudio-community
Params7.61B
Context32K
Q4_K_M4.7 GB
CodingTool useVision
CO
codegemma-7b
Codegemma · lmstudio-community
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
ME
Google_Medgemma 27b Text It
Medgemma · lmstudio-community
Params27B
Context128K
Q4_K_M16.5 GB
GGUF

Keep browsing