GGUF models by lmstudio-community
432 GGUF models quantized by lmstudio-community on Hugging Face. Sizes run from 30M to 671B parameters. The longest trained context is 10240K tokens.
NE
OpenCodeReasoning Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen_Qwen3 VL 235B A22B Thinking
Qwen · lmstudio-community
Params235B
Context256K
Q4_K_M142.2 GB
CO
C4Ai Command R Plus 08 2024
Command R · lmstudio-community
Params104B
Context128K
Q4_K_M62.8 GB
GR
Granite Embedding 107m Multilingual
Granite · lmstudio-community
Params107M
Context512
Q4_K_M0.1 GB
GR
Granite Embedding 278m Multilingual
Granite · lmstudio-community
Params277M
Context512
Q4_K_M0.2 GB
DA
datagemma rig 27b it
Datagemma · lmstudio-community
Params27.2B
Context8K
Q4_K_M16.6 GB
GL
GLM Z1 32B 0414
GLM · lmstudio-community
Params32.6B
Context32K
Q4_K_M19.7 GB
AY
aya-23-35B
Aya · lmstudio-community
Params35B
Context8K
Q4_K_M21.5 GB
QW
Qwen1.5-32B-Chat
Qwen · lmstudio-community
Params32.5B
Context32K
Q4_K_M19.7 GB
LF
LiquidAI_LFM2.5 350M
Lfm · lmstudio-community
Params354M
Context125K
Smallest0.4 GB
GL
GLM Z1 Rumination 32B 0414
GLM · lmstudio-community
Params33.1B
Context128K
Q4_K_M20.0 GB
IN
Intern S1
InternLM · lmstudio-community
Params235B
Context40K
Q4_K_M142.7 GB
LL
Llama 3.1 Nemotron Nano 4B v1.1
Llama · lmstudio-community
Params4.51B
Context128K
Q4_K_M2.8 GB
GR
Granite 3.1 2b Instruct
Granite · lmstudio-community
Params2.53B
Context128K
Q4_K_M1.5 GB
HU
Hunyuan A13B Instruct
Hunyuan · lmstudio-community
Params80.4B
Context256K
Q4_K_M49.3 GB
GR
Granite 3.2 2b Instruct
Granite · lmstudio-community
Params2.53B
Context128K
Q4_K_M1.5 GB
GR
Ibm Granite_Granite 4.0 H Small
Granite · lmstudio-community
Params32.2B
Context1024K
Q4_K_M19.5 GB
AY
Aya Expanse 32b
Aya · lmstudio-community
Params32.3B
Context8K
Q4_K_M19.8 GB
IN
InternVL3_5 30B A3B
Internvl · lmstudio-community
Params30.5B
Context40K
Q4_K_M18.6 GB
CO
C4Ai Command R 08 2024
Command R · lmstudio-community
Params32.3B
Context128K
Q4_K_M19.8 GB
QW
Qwen2 Math 7B Instruct
Qwen · lmstudio-community
Params7.62B
Context4K
Q4_K_M4.7 GB
AF
AFM 4.5B
Afm · lmstudio-community
Params4.62B
Context64K
Q4_K_M2.9 GB
OL
allenai_Olmo 3 7B Think
OLMo · lmstudio-community
Params7.3B
Context64K
Q4_K_M4.5 GB
GL
GLM 4.5
GLM · lmstudio-community
Params358B
Context128K
Q4_K_M218.5 GB
MI
internlm2-math-plus-mixtral8x22b
Mistral · lmstudio-community
Params141B
Context64K
Q4_K_M85.6 GB
LL
ChatQA-1.5-8B
Llama · lmstudio-community
Params8.03B
Context8K
Q4_K_M4.9 GB
GE
Gemma 2b Aps It
Gemma · lmstudio-community
Params2.51B
Context8K
Q4_K_M1.6 GB
GR
Granite 3.0 3b A800M Instruct
Granite · lmstudio-community
Params3.37B
Context4K
Q4_K_M2.1 GB
SA
Sarvam M
Sarvam · lmstudio-community
Params23.6B
Context32K
Q4_K_M14.3 GB
EX
EXAONE 4.0.1 32B
Exaone · lmstudio-community
Params32B
Context128K
Q4_K_M19.3 GB