GGUF models by lmstudio-community
432 GGUF models quantized by lmstudio-community on Hugging Face. Sizes run from 30M to 671B parameters. The longest trained context is 10240K tokens.
R1
R1 1776
lmstudio-community
Params671B
Context160K
Q4_K_M404.4 GB
LL
Cogito v2 Preview Llama 70B
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
OP
Openhands Lm 1.5b v0.1
Openhands · lmstudio-community
Params1.54B
Context32K
Q4_K_M1.0 GB
NE
OpenMath Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
JE
Jedi 7B 1080p
Jedi · lmstudio-community
Params7.62B
Context125K
Q4_K_M4.7 GB
OL
allenai_Olmo 3 1025 7B
OLMo · lmstudio-community
Params7.3B
Context64K
Q4_K_M4.5 GB
TX
Txgemma 27b Chat
Txgemma · lmstudio-community
Params27.2B
Context8K
Q4_K_M16.6 GB
QW
Cogito v1 Preview Qwen 14B
Qwen · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
KA
Kwaipilot_KAT Dev
Kat · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.8 GB
QW
QwQ 32B Preview
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
IN
Internlm2_5 1_8b Chat
InternLM · lmstudio-community
Params1.89B
Context32K
Q4_K_M1.2 GB
AC
AceInstruct 72B
Aceinstruct · lmstudio-community
Params72.7B
Context128K
Q4_K_M47.4 GB
AT
Athene V2 Agent
Athene · lmstudio-community
Params72.7B
Context32K
Q4_K_M47.4 GB
FA
Falcon3 3B Instruct
Falcon · lmstudio-community
Params3.23B
Context32K
Q4_K_M2.0 GB
SK
Skywork OR1 32B Preview
Skywork · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
IN
Internlm3 8b Instruct
InternLM · lmstudio-community
Params8.8B
Context32K
Q4_K_M5.4 GB
LL
Cogito v1 Preview Llama 70B
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
FineMath Llama 3B
Llama · lmstudio-community
Params3.21B
Context4K
Q4_K_M2.0 GB
TH
AM Thinking v1
Thinking · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
Llama 3_1 Nemotron 51B Instruct
Llama · lmstudio-community
Params51.5B
Context128K
Q4_K_M31.0 GB
GE
Gemma 7b Aps It
Gemma · lmstudio-community
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
Cogito v2 Preview Llama 109B MoE
Llama · lmstudio-community
Params108B
Context256K
Q4_K_M67.7 GB
AC
AceInstruct 7B
Aceinstruct · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
KE
KernelLLM
Kernelllm · lmstudio-community
Params8.03B
Context128K
Q4_K_M4.9 GB
SK
Skywork OR1 Math 7B
Skywork · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
NE
OpenMath Nemotron 1.5B
Nemotron · lmstudio-community
Params1.54B
Context128K
Q4_K_M1.0 GB
IN
INTELLECT 2
Intellect · lmstudio-community
Params32.8B
Context40K
Q4_K_M19.9 GB
HE
NousResearch_Hermes 4 405B
Hermes · lmstudio-community
Params406B
Context128K
Q4_K_M243.1 GB
EX
LGAI EXAONE_EXAONE 4.0 32B
Exaone · lmstudio-community
Params32B
Context128K
Q4_K_M19.3 GB
OL
AMD OLMo 1B SFT
OLMo · lmstudio-community
Params1.18B
Context2K
Q4_K_M0.7 GB