GGUF models by legraphista
138 GGUF models quantized by legraphista on Hugging Face. Sizes run from 494M to 236B parameters. The longest trained context is 1024K tokens.
SH
Shieldgemma 9b
Shieldgemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
QW
Qwen2 Math 7B Instruct
Qwen · legraphista
Params7.62B
Context4K
Smallest1.9 GB
MI
Mistral Small Instruct 2409
Mistral · legraphista
Params22.2B
Context128K
Smallest4.8 GB
QW
Qwen2-72B-Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest22.7 GB
CO
Yi Coder 1.5B
Coder · legraphista
Params1.48B
Context128K
Smallest0.5 GB
RO
RoLlama2-7b-Instruct
Rollama · legraphista
Params6.74B
Context4K
Q4_K_M4.1 GB
CO
Yi Coder 1.5B Chat
Coder · legraphista
Params1.48B
Context128K
Smallest0.5 GB
AU
AutoCoder_S_6.7B
Autocoder · legraphista
Params6.74B
Context16K
Smallest1.5 GB
IN
InternLM2
InternLM · legraphista
Params7.74B
Context256K
Smallest1.9 GB
CH
K2-Chat
Chat · legraphista
Params65.3B
Context8K
Smallest14.2 GB
RO
RoMistral-7b-Instruct
Romistral · legraphista
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mathstral-7B-v0.1
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
QW
Qwen2 Math 72B Instruct
Qwen · legraphista
Params72.7B
Context4K
Smallest23.7 GB
QW
Qwen2-57B-A14B-Instruct
Qwen · legraphista
Params57.4B
Context32K
Smallest39.6 GB
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Q4_K_M21.5 GB
RO
RoLlama2-7b-Chat
Rollama · legraphista
Params6.74B
Context4K
Q4_K_M4.1 GB
AY
aya-23-8B
Aya · legraphista
Params8.03B
Context8K
Q4_K_M5.1 GB
RO
RoLlama2-7b-Base
Rollama · legraphista
Params6.74B
Context4K
Q4_K_M4.1 GB