Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
LL
Llm Jp 4 33b Thinking
Llm · llm-jp
Params33.2B
Context64K
Q4_K_M20.2 GB
GR
grug 27b
Grug · ProCreations
Params27B
Context256K
Q4_K_M16.5 GB
QW
Qwythos-27B
Qwythos · empero-ai
Params27B
Context1024K
Q4_K_M17.3 GB
MI
MiniMax H3
Minimax · leejet
Params20.1B
Context—
Q4_K_M11.4 GB
QW
Qwopus3.6 27B Fusion
Qwen · KyleHessling1
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
Google_Gemma 4 12B It Qat Q4_0 Unquantized
Gemma · lmstudio-community
Params11.9B
Context256K
Smallest7.0 GB
GE
gemma 4 12B agentic fable5 composer2.5 v2 3.5x tau2
Gemma · yuxinlu1
Params11.9B
Context256K
Q4_K_M7.4 GB
GL
Glm-4.7-Flash
GLM · unsloth
Params30B
Context198K
Q4_K_M18.3 GB
HE
Hemmingway 1
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GE
POCKET 26B
Gemma · FINAL-Bench
Params25.2B
Context256K
Q4_K_M16.8 GB
GR
Granite 4.2 30b
Granite · ibm-granite
Params29.3B
Context128K
Q4_K_M17.7 GB
BO
Bonsai-27B
Bonsai · lmstudio-community
Params27B
Context256K
Smallest3.8 GB
NO
North-Mini-Code-1.0
North · unsloth
Params30.5B
Context488K
Q4_K_M19.2 GB
TE
Tess-4.5-27B
Tess · migtissera
Params27B
Context256K
Q4_K_M2.0 GB
QW
Swift 1.5 Qwen3.8 27B
Qwen · ukisai
Params27.3B
Context256K
Q4_K_M17.4 GB
MU
Muse Glimmer 30B
Muse · meta-models
Params27.9B
Context128K
Q4_K_M1.6 GB
FL
FLUX.1 dev
Flux · city96
Params11.9B
Context—
Smallest4.0 GB
MI
MiniMax H3
Minimax · Abiray
Params25.8B
Context—
Q4_K_M14.6 GB
QW
Qwen3.8 27B Coder390 EfficientThink Opus5.5 GPT6Astra Grok4.7 DSV4Pro K3 SFT RLOO GGUF NInfer
Qwen · nerkyor
Params27.3B
Context256K
Smallest0.0 GB
WA
Wan2.1 I2V 14B 480P
Wan · city96
Params16.4B
Context—
Q4_K_M11.3 GB
LF
LFM2.5-24B-A2B
Lfm · LiquidAI
Params24B
Context128K
Q4_K_M14.5 GB
GE
gemma 4 26B A4B it qat q4 0
Gemma · google
Params25.2B
Context256K
Smallest14.4 GB
NE
NVIDIA-Nemotron-3.5-Lightning-30B-A3B
Nemotron · ggml-org
Params31.6B
Context1024K
Smallest1.2 GB
GE
humanizer-12b
Gemma · jialinyyzz
Params11.9B
Context256K
Q4_K_M7.6 GB
LA
Laguna XS 2.1
Laguna · poolside
Params33.4B
Context256K
Q4_K_M20.3 GB
LF
LFM2.5 24B A2B Uncensored
Lfm · AtomicChat
Params24B
Context128K
Q4_K_M15.4 GB
QW
Qwen2.5 Coder 14B Instruct AWQ
Qwen · Qwen
Params29B
Context128K
Q4_K_M18.0 GB
QW
Qwen3.8 27B Uncensored
Qwen · azukivc
Params27.3B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.8 27B Defiance Uncensored MTP
Qwen · ttindall
Params27.3B
Context—
Smallest0.9 GB
LF
LFM2.5-24B-A2B-Preview
Lfm · unsloth
Params24B
Context128K
Smallest7.5 GB