Medium GGUF models

42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SO
SOLAR 10.7B Instruct v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
HA
HarmonicHarlequin v5 20B
Harmonicharlequin · mradermacher
Params33.3B
Context4K
Q4_K_M20.1 GB
GGUF
DE
DeepSeek-V2-Lite
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
LL
Code-Llama-2-13B-instruct-text2sql
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
PS
Psyonic-Rose-20B-Higher-Quality
Psyonic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
GGUF
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
GGUF
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
GL
LFM2 12B A1B GLM 4.7 Thinking Quantum IQ1C P TR1 S2
GLM · mradermacher
Params11.3B
Context125K
Q4_K_M6.8 GB
CodingReasoningRoleplay
VI
lmsys_vicuna-13b-v1.5-16k
Vicuna · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
TA
talkie-1930-13b-it
Talkie · PocketAiHub
Params13.3B
Context2K
Q4_K_M8.6 GB
GGUF
EQ
Equinox 31B
Equinox · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
RoleplayVision
QW
Qwen_Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · bartowski
Params12.3B
Context1024K
Q4_K_M7.5 GB
GGUF
CO
Codeqwen3 14b
Codeqwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoning
LL
Phind CodeLlama 34B v2
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
MI
Magistral Small 2506
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
MI
NousResearch DeepHermes 3 Mistral 24B Preview
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
ReasoningRoleplayTool use
TI
TigerCoder 12B
Tigercoder · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding
LL
nkpz_llama2-22b-daydreamer-v3
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
GGUF
MI
macadeliccc_laser-dolphin-mixtral-2x7b-dpo
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
PR
PromptEnhancer 32B
Promptenhancer · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
GGUF
CH
Chinese Alpaca 2 13B
Chinese · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
GGUF
CO
Code 290k 13B
Code · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
Coding
QW
qwen2.5 coder 32b combined verilog c i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
Coding
TO
llm-agents_tora-code-13b-v1.0
Tora · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
Coding
OR
Ornstein 27B
Ornstein · GestaltLabs
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningVision
XO
XortronCriminalComputingConfig
Xortroncriminalcomputingconfig · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
LF
LFM2.5 24B A2B Abliterated
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · second-state
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
GU
Guanaco 13B Uncensored
Guanaco · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Other sizes

Keep browsing