Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llm Jp 4 33b Thinking
Llm · llm-jp
Params33.2B
Context64K
Q4_K_M20.2 GB
Reasoning
GR
grug 27b
Grug · ProCreations
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
QW
Qwythos-27B
Qwythos · empero-ai
Params27B
Context1024K
Q4_K_M17.3 GB
ReasoningVision
MI
MiniMax H3
Minimax · leejet
Params20.1B
Context—
Q4_K_M11.4 GB
GGUF
QW
Qwopus3.6 27B Fusion
Qwen · KyleHessling1
Params27.3B
Context256K
Q4_K_M16.8 GB
CodingReasoningVision
GE
Google_Gemma 4 12B It Qat Q4_0 Unquantized
Gemma · lmstudio-community
Params11.9B
Context256K
Smallest7.0 GB
Vision
GE
gemma 4 12B agentic fable5 composer2.5 v2 3.5x tau2
Gemma · yuxinlu1
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GL
Glm-4.7-Flash
GLM · unsloth
Params30B
Context198K
Q4_K_M18.3 GB
GGUF
HE
Hemmingway 1
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
POCKET 26B
Gemma · FINAL-Bench
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GR
Granite 4.2 30b
Granite · ibm-granite
Params29.3B
Context128K
Q4_K_M17.7 GB
GGUF
BO
Bonsai-27B
Bonsai · lmstudio-community
Params27B
Context256K
Smallest3.8 GB
Vision
NO
North-Mini-Code-1.0
North · unsloth
Params30.5B
Context488K
Q4_K_M19.2 GB
Coding
TE
Tess-4.5-27B
Tess · migtissera
Params27B
Context256K
Q4_K_M2.0 GB
ReasoningVision
QW
Swift 1.5 Qwen3.8 27B
Qwen · ukisai
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningVision
MU
Muse Glimmer 30B
Muse · meta-models
Params27.9B
Context128K
Q4_K_M1.6 GB
Vision
FL
FLUX.1 dev
Flux · city96
Params11.9B
Context—
Smallest4.0 GB
GGUF
MI
MiniMax H3
Minimax · Abiray
Params25.8B
Context—
Q4_K_M14.6 GB
GGUF
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO GGUF NInfer
Qwen · nerkyor
Params27.3B
Context256K
Smallest0.0 GB
GGUF
WA
Wan2.1 I2V 14B 480P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
GGUF
LF
LFM2.5-24B-A2B
Lfm · LiquidAI
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
GE
gemma 4 26B A4B it qat q4 0
Gemma · google
Params25.2B
Context256K
Smallest14.4 GB
Vision
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · ggml-org
Params31.6B
Context1024K
Smallest1.2 GB
GGUF
GE
humanizer-12b
Gemma · jialinyyzz
Params11.9B
Context256K
Q4_K_M7.6 GB
Vision
LA
Laguna XS 2.1
Laguna · poolside
Params33.4B
Context256K
Q4_K_M20.3 GB
GGUF
LF
LFM2.5 24B A2B Uncensored
Lfm · AtomicChat
Params24B
Context128K
Q4_K_M15.4 GB
ReasoningTool use
QW
Qwen2.5 Coder 14B Instruct AWQ
Qwen · Qwen
Params29B
Context128K
Q4_K_M18.0 GB
Coding
QW
Qwen3.8 27B Uncensored
Qwen · azukivc
Params27.3B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.8 27B Defiance Uncensored MTP
Qwen · ttindall
Params27.3B
Context—
Smallest0.9 GB
GGUF
LF
LFM2.5-24B-A2B-Preview
Lfm · unsloth
Params24B
Context128K
Smallest7.5 GB
GGUF

Other sizes

Keep browsing