Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
MI
Mistral Nemo Instruct 2407
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
MR_MARTIN_31b_V1.0_Gemma 4 Base Ftp
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
MinimaxH3 base
Minimaxh · EllaPriest45
Params25.8B
Context—
Q4_K_M13.8 GB
QW
Qwen3.8 27B OBLITERATED
Qwen · 007soham
Params27.3B
Context256K
Q4_K_M16.8 GB
PH
Phi 3 medium 128k instruct imatrix
Phi · duyntnet
Params14B
Context128K
Q4_K_M8.6 GB
LT
LTX2.3 10Eros
Ltx · Abiray
Params21B
Context—
Q4_K_M14.3 GB
ST
Starcoder
StarCoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
AS
ASTRA 14B Thinking v1
Astra · mradermacher
Params14.8B
Context130K
Q4_K_M9.0 GB
MU
Muse Glimmer 30B ROCmFP4 Strix Halo DFlash
Muse · kingjones777
Params28B
Context128K
Smallest1.5 GB
QW
Qwen3.6 Whittle 25B A3B
Qwen · logic65
Params25.6B
Context256K
Q4_K_M15.7 GB
PA
PathfinderAI5.0 i1
Pathfinderai · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
TH
TherapyBeagle 11B v2 i1
Therapybeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
RI
Rivermind 24B v1
Rivermind · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
GE
Gemma 4 Novelist Eclipse 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
MI
K2S3 Mistral 7bx2 48layers_v1.2
Mistral · RichardErkhov
Params10.9B
Context32K
Q4_K_M6.6 GB
ER
ERNIE 4.5 21B A3B PT
Ernie · lmstudio-community
Params21.8B
Context128K
Q4_K_M13.5 GB
HE
conceptofmind_hermes-llongma-2-13b-8k
Hermes · TheBloke
Params13B
Context8K
Q4_K_M7.9 GB
DE
DeepSeek R1 Distill Qwen 32B Uncensored
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
LU
G4 LuneLight 31B
Lunelight · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
Dolphin Mistral 24B Venice Edition Heretic
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ST
StarCoder
StarCoder · mradermacher
Params15.5B
Context8K
Q4_K_M10.0 GB
GR
Granite 20b Code Base 8k
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
QW
Qwen3 VL 32B Gemini Heretic Uncensored Thinking
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
FE
feyospace-v1.1-small
Feyospace · Etherll
Params27.3B
Context256K
Smallest29.0 GB
QW
Qwen3.8 27B AEON ULTIMATE UNCENSORED
Qwen · vcruz305
Params27.3B
Context256K
Q4_K_M16.8 GB
TI
TigerLLM 12B It
Tigerllm · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma-4-26B-A4B-It
Gemma · noctrex
Params25.2B
Context256K
Smallest15.4 GB
SO
solar merge v1.0 i1
Solar · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
QW
Qwen2.5 Coder 14B Instruct Uncensored
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
ME
G4 MeroMero 26B A4B
Meromero · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB