GGUF models by lmstudio-community

432 GGUF models quantized by lmstudio-community on Hugging Face. Sizes run from 30M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama-3-Groq-8B-Tool-Use
Llama · lmstudio-community
Params8B
Context8K
Q4_K_M4.9 GB
Tool use
GE
Gemma 3 1b
Gemma · lmstudio-community
Params1B
Context32K
Smallest0.7 GB
GGUF
QW
Qwen_Qwen3 VL 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
QW
Qwen_Qwen3 0.6B
Qwen · lmstudio-community
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
QW
QwQ 32B
Qwen · lmstudio-community
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
GE
gemma 3n E4B it text
Gemma · lmstudio-community
Params6.9B
Context32K
Q4_K_M4.2 GB
GGUF
GR
Ibm Granite_Granite 4.0 H Tiny
Granite · lmstudio-community
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
PH
Phi 4 Reasoning Plus
Phi · lmstudio-community
Params14.7B
Context32K
Q4_K_M9.1 GB
CodingReasoning
MI
Codestral-22B-v0.1
Mistral · lmstudio-community
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B
Nemotron · lmstudio-community
Params74B
Context256K
Smallest22.0 GB
Vision
MI
mistralai_Ministral 3 8B Instruct 2512 BF16
Mistral · lmstudio-community
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
RN
EssentialAI_rnj 1 Instruct
Rnj · lmstudio-community
Params8.3B
Context32K
Q4_K_M5.1 GB
GGUF
LF
LFM3-VL-2B
Lfm · lmstudio-community
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
QW
Qwen2.5 1.5B Instruct
Qwen · lmstudio-community
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen2.5 VL 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
SM
SmolLM2 1.7B Instruct
SmolLM · lmstudio-community
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
NE
NVIDIA Nemotron 3 Nano 30B A3B
Nemotron · lmstudio-community
Params31.6B
Context1024K
Q4_K_M24.5 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
DE
DeepSeek R1 Distill Llama 70B
DeepSeek · lmstudio-community
Params70.6B
Context128K
Q4_K_M42.5 GB
Reasoning
MI
mistralai_Ministral 3 14B Instruct 2512 BF16
Mistral · lmstudio-community
Params13.5B
Context256K
Q4_K_M8.2 GB
Vision
QW
Qwen3 32B
Qwen · lmstudio-community
Params32.8B
Context32K
Q4_K_M19.8 GB
GGUF
QW
Qwen2.5 VL 72B Instruct
Qwen · lmstudio-community
Params72.7B
Context125K
Q4_K_M47.4 GB
Vision
NE
Nemotron 3 Super 120B A12B
Nemotron · lmstudio-community
Params121B
Context1024K
Q4_K_M86.1 GB
GGUF
GE
Gemma 2 2b It
Gemma · lmstudio-community
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · lmstudio-community
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
GE
Google_Gemma 4 E4B It Qat Q4_0 Unquantized
Gemma · lmstudio-community
Params7.46B
Context128K
Smallest5.2 GB
Vision
GE
gemma-2-27b-it
Gemma · lmstudio-community
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 3 27b
Gemma · lmstudio-community
Params27B
Context128K
Smallest15.6 GB
Vision
MI
MiniMaxAI_MiniMax M2.7
Minimax · lmstudio-community
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
QW
Qwen2.5 Coder 14B
Qwen · lmstudio-community
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding

Keep browsing