GGUF models by lmstudio-community
432 GGUF models quantized by lmstudio-community on Hugging Face. Sizes run from 30M to 671B parameters. The longest trained context is 10240K tokens.
QW
Qwen_Qwen3 VL 235B A22B Instruct
Qwen · lmstudio-community
Params235B
Context256K
Q4_K_M142.2 GB
AY
aya-23-8B
Aya · lmstudio-community
Params8.03B
Context8K
Q4_K_M5.1 GB
IN
AlchemistCoder-L-7B
InternLM · lmstudio-community
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
MindLink 32B 0801
Mindlink · lmstudio-community
Params32.8B
Context40K
Q4_K_M19.8 GB
FU
Gg Hf Gm_Functiongemma 270m It
Functiongemma · lmstudio-community
Params268M
Context32K
Smallest0.5 GB
FA
Falcon3 7B Instruct
Falcon · lmstudio-community
Params7.46B
Context32K
Q4_K_M4.6 GB
KW
KwaiCoder AutoThink Preview
Kwaicoder · lmstudio-community
Params40.6B
Context32K
Q4_K_M24.6 GB
GR
Granite 3.0 1b A400M Instruct
Granite · lmstudio-community
Params1.33B
Context4K
Q4_K_M0.8 GB
DE
DeepSeek V3 0324
DeepSeek · lmstudio-community
Params671B
Context160K
Q4_K_M404.4 GB
DE
DeepSeek V2.5 1210
DeepSeek · lmstudio-community
Params236B
Context160K
Q4_K_M142.5 GB
GR
Granite 3.3 8b Instruct
Granite · lmstudio-community
Params8.17B
Context128K
Q4_K_M4.9 GB
MI
Mistral Small Instruct 2409
Mistral · lmstudio-community
Params22.2B
Context128K
Q4_K_M13.3 GB
LI
Ling Lite 0415
Ling · lmstudio-community
Params16.8B
Context32K
Q4_K_M11.2 GB
NE
OpenCodeReasoning Nemotron 32B IOI
Nemotron · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
GR
Ibm Granite_Granite 4.0 H Micro
Granite · lmstudio-community
Params3.19B
Context1024K
Q4_K_M1.9 GB
QW
Qwen2 Math 1.5B Instruct
Qwen · lmstudio-community
Params1.54B
Context4K
Q4_K_M1.0 GB
GR
Granite 3.3 2b Instruct
Granite · lmstudio-community
Params2.53B
Context128K
Q4_K_M1.5 GB
MI
Mistral Large Instruct 2411
Mistral · lmstudio-community
Params123B
Context128K
Q4_K_M73.2 GB
LL
Llama 3.1 Tulu 3 70B
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama 3 1 Nemotron Ultra 253B v1
Llama · lmstudio-community
Params253B
Context128K
Q4_K_M150.9 GB
CO
C4Ai Command A 03 2025
Command R · lmstudio-community
Params111B
Context16K
Q4_K_M67.1 GB
LL
Llama 3.1 Tulu 3 405B
Llama · lmstudio-community
Params405B
Context128K
Q4_K_M243.1 GB
NE
OpenCodeReasoning Nemotron 32B
Nemotron · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3 235B A22B Thinking 2507
Qwen · lmstudio-community
Params235B
Context256K
Q4_K_M142.6 GB
GR
Ibm Granite_Granite 4.1 30b
Granite · lmstudio-community
Params28.9B
Context128K
Q4_K_M17.5 GB
RE
Reka Flash 3
Reka · lmstudio-community
Params20.9B
Context32K
Q4_K_M13.6 GB
DA
datagemma rag 27b it
Datagemma · lmstudio-community
Params27.2B
Context8K
Q4_K_M16.6 GB
NE
OpenReasoning Nemotron 32B
Nemotron · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · lmstudio-community
Params8.04B
Context4192K
Q4_K_M4.9 GB
TA
UI TARS 72B DPO
Tars · lmstudio-community
Params72.7B
Context32K
Q4_K_M47.4 GB