GGUF models by lmstudio-community
432 GGUF models quantized by lmstudio-community on Hugging Face. Sizes run from 30M to 671B parameters. The longest trained context is 10240K tokens.
AT
Athene-70B
Athene · lmstudio-community
Params70.6B
Context8K
Q4_K_M42.5 GB
NE
OpenCodeReasoning Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context32K
Q4_K_M4.7 GB
SK
Skywork R1V3 38B
Skywork · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.8 GB
OP
Openhands Lm 32b v0.1
Openhands · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
NE
OpenReasoning Nemotron 1.5B
Nemotron · lmstudio-community
Params1.54B
Context128K
Q4_K_M1.0 GB
LL
Cogito v1 Preview Llama 8B
Llama · lmstudio-community
Params8.03B
Context128K
Q4_K_M4.9 GB
DE
DeepSeek R1 0528
DeepSeek · lmstudio-community
Params671B
Context160K
Q4_K_M409.2 GB
OP
OpenCoder 8B Instruct
Opencoder · lmstudio-community
Params7.77B
Context8K
Q4_K_M4.7 GB
OL
olmOCR 7B 0225 Preview
OLMo · lmstudio-community
Params7.62B
Context32K
Q4_K_M4.7 GB
NE
AceReason Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
DE
DeepSeek R1
DeepSeek · lmstudio-community
Params671B
Context160K
Q4_K_M404.4 GB
LF
LFM2 VL 1.6B
Lfm · lmstudio-community
Params1.17B
Context125K
Q4_K_M0.7 GB
NE
AceReason Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
GR
Granite Embedding 30m English
Granite · lmstudio-community
Params30M
Context512
Q4_K_M0.0 GB
NE
OpenMath Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · lmstudio-community
Params1.78B
Context128K
Q4_K_M1.1 GB
MI
Magistral-Small-2507
Mistral · lmstudio-community
Params23.6B
Context40K
Q4_K_M14.3 GB
OP
OpenThinker 32B
Openthinker · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
IN
Internlm2_5 20b Chat
InternLM · lmstudio-community
Params19.9B
Context32K
Q4_K_M12.0 GB
OL
OlympicCoder 7B
Olympiccoder · lmstudio-community
Params7.62B
Context32K
Q4_K_M4.7 GB
EX
EXAONE Deep 7.8B
Exaone · lmstudio-community
Params7.82B
Context32K
Q4_K_M4.8 GB
NE
OpenMath Nemotron 32B
Nemotron · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
JE
Jedi 3B 1080p
Jedi · lmstudio-community
Params3.09B
Context125K
Q4_K_M1.9 GB
DO
Dots.Llm1.Inst
Dots · lmstudio-community
Params143B
Context32K
Q4_K_M96.1 GB
FA
Falcon3 1B Instruct
Falcon · lmstudio-community
Params1.67B
Context8K
Q4_K_M1.1 GB
QW
Cogito v1 Preview Qwen 32B
Qwen · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.8 GB
TX
Txgemma 9b Chat
Txgemma · lmstudio-community
Params9.24B
Context8K
Q4_K_M5.8 GB
AT
Athene V2 Chat
Athene · lmstudio-community
Params72.7B
Context32K
Q4_K_M47.4 GB
GR
Granite 3.0 2b Instruct
Granite · lmstudio-community
Params2.63B
Context4K
Q4_K_M1.6 GB
OL
allenai_Olmo 3.1 32B Think
OLMo · lmstudio-community
Params32.2B
Context64K
Q4_K_M19.5 GB