Medium GGUF models
42835 GGUF models with roughly 10B to 34B parameters. Sizes run from 9.51B to 34B parameters. The longest trained context is 10240K tokens.
SO
SOLAR 10.7B Instruct v1.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
HA
HarmonicHarlequin v5 20B
Harmonicharlequin · mradermacher
Params33.3B
Context4K
Q4_K_M20.1 GB
DE
DeepSeek-V2-Lite
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
LL
Code-Llama-2-13B-instruct-text2sql
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
PS
Psyonic-Rose-20B-Higher-Quality
Psyonic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
QW
Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
QwQ 32B Preview
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GL
LFM2 12B A1B GLM 4.7 Thinking Quantum IQ1C P TR1 S2
GLM · mradermacher
Params11.3B
Context125K
Q4_K_M6.8 GB
VI
lmsys_vicuna-13b-v1.5-16k
Vicuna · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
TA
talkie-1930-13b-it
Talkie · PocketAiHub
Params13.3B
Context2K
Q4_K_M8.6 GB
EQ
Equinox 31B
Equinox · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
QW
Qwen_Qwen3 14B
Qwen · Alcoft
Params14.8B
Context40K
Q4_K_M9.0 GB
NE
NVIDIA Nemotron Nano 12B v2
Nemotron · bartowski
Params12.3B
Context1024K
Q4_K_M7.5 GB
CO
Codeqwen3 14b
Codeqwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
LL
Phind CodeLlama 34B v2
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
MI
Magistral Small 2506
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
MI
NousResearch DeepHermes 3 Mistral 24B Preview
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
TI
TigerCoder 12B
Tigercoder · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
LL
nkpz_llama2-22b-daydreamer-v3
Llama · TheBloke
Params21.8B
Context4K
Q4_K_M13.2 GB
MI
macadeliccc_laser-dolphin-mixtral-2x7b-dpo
Mistral · TheBloke
Params12.9B
Context32K
Q4_K_M7.8 GB
PR
PromptEnhancer 32B
Promptenhancer · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
CH
Chinese Alpaca 2 13B
Chinese · TheBloke
Params13.3B
Context4K
Q4_K_M8.0 GB
CO
Code 290k 13B
Code · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
QW
qwen2.5 coder 32b combined verilog c i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
TO
llm-agents_tora-code-13b-v1.0
Tora · TheBloke
Params13B
Context16K
Q4_K_M7.9 GB
OR
Ornstein 27B
Ornstein · GestaltLabs
Params27B
Context256K
Q4_K_M16.5 GB
XO
XortronCriminalComputingConfig
Xortroncriminalcomputingconfig · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
LF
LFM2.5 24B A2B Abliterated
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · second-state
Params14.8B
Context128K
Q4_K_M9.0 GB
GU
Guanaco 13B Uncensored
Guanaco · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB