GGUF models by lmstudio-community
432 GGUF models quantized by lmstudio-community on Hugging Face. Sizes run from 30M to 671B parameters. The longest trained context is 10240K tokens.
PH
Phi 4 Reasoning
Phi · lmstudio-community
Params14.7B
Context32K
Q4_K_M9.1 GB
LF
LiquidAI_LFM2.5 1.2B Thinking
Lfm · lmstudio-community
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Qwen_Qwen3 VL 4B Thinking
Qwen · lmstudio-community
Params4.02B
Context256K
Q4_K_M2.5 GB
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4 LiLiCorr
Nemotron · lmstudio-community
Params1.66B
Context1024K
Smallest1.4 GB
MI
mathstral-7B-v0.1
Mistral · lmstudio-community
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
Meta-Llama-3-8B-Instruct
Llama · lmstudio-community
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
InternVL3_5 1B
Internvl · lmstudio-community
Params752M
Context40K
Q4_K_M0.5 GB
IN
InternLM2
InternLM · lmstudio-community
Params19.9B
Context8K
Q4_K_M12.0 GB
MI
MiniMaxAI_MiniMax M2
Minimax · lmstudio-community
Params229B
Context192K
Q4_K_M138.3 GB
QW
Qwen2.5 Coder 0.5B
Qwen · lmstudio-community
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen2 Math 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context4K
Q4_K_M47.4 GB
OL
allenai_Olmo 3 7B Instruct
OLMo · lmstudio-community
Params7.3B
Context64K
Q4_K_M4.5 GB
IN
InternVL3_5 14B
Internvl · lmstudio-community
Params14.8B
Context40K
Q4_K_M9.0 GB
NE
OpenReasoning Nemotron 14B
Nemotron · lmstudio-community
Params14.8B
Context128K
Q4_K_M9.0 GB
NO
nomic embed code
Nomic · lmstudio-community
Params7.07B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 Nemotron 70B Instruct HF
Llama · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Llama3-ChatQA-1.5-70B
Llama · lmstudio-community
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen_Qwen3 Next 80B A3B Thinking
Qwen · lmstudio-community
Params79.7B
Context256K
Q4_K_M48.5 GB
LL
Meta-Llama-3-70B-Instruct
Llama · lmstudio-community
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Qwen2 VL 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context32K
Q4_K_M47.4 GB
ER
ERNIE 4.5 0.3B PT
Ernie · lmstudio-community
Params361M
Context128K
Q4_K_M0.2 GB
FA
Falcon3 10B Instruct
Falcon · lmstudio-community
Params10.3B
Context32K
Q4_K_M6.3 GB
QW
Qwen_Qwen3 VL 2B Thinking
Qwen · lmstudio-community
Params1.72B
Context256K
Q4_K_M1.1 GB
LL
Llama 3.1 8B UltraLong 1M Instruct
Llama · lmstudio-community
Params8.04B
Context1048K
Q4_K_M4.9 GB
NE
OpenReasoning Nemotron 7B
Nemotron · lmstudio-community
Params7.62B
Context128K
Q4_K_M4.7 GB
GR
Granite 3.1 3b A800M Instruct
Granite · lmstudio-community
Params3.3B
Context128K
Q4_K_M2.0 GB
PH
Phi 3.5 MoE Instruct
Phi · lmstudio-community
Params41.9B
Context128K
Q4_K_M25.3 GB
QW
Qwen_Qwen3.5 397B A17B
Qwen · lmstudio-community
Params396B
Context256K
Q4_K_M240.6 GB
EU
EuroLLM 9B Instruct
Eurollm · lmstudio-community
Params9.15B
Context4K
Q4_K_M5.6 GB
GE
DiscoPOP-zephyr-7b-gemma
Gemma · lmstudio-community
Params8.54B
Context8K
Q4_K_M6.3 GB