GGUF models by legraphista

138 GGUF models quantized by legraphista on Hugging Face. Sizes run from 494M to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SH
Shieldgemma 9b
Shieldgemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
GGUF
QW
Qwen2 Math 7B Instruct
Qwen · legraphista
Params7.62B
Context4K
Smallest1.9 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · legraphista
Params22.2B
Context128K
Smallest4.8 GB
Tool use
QW
Qwen2-72B-Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest22.7 GB
GGUF
CO
Yi Coder 1.5B
Coder · legraphista
Params1.48B
Context128K
Smallest0.5 GB
Coding
RO
RoLlama2-7b-Instruct
Rollama · legraphista
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
CO
Yi Coder 1.5B Chat
Coder · legraphista
Params1.48B
Context128K
Smallest0.5 GB
Coding
AU
AutoCoder_S_6.7B
Autocoder · legraphista
Params6.74B
Context16K
Smallest1.5 GB
Coding
IN
InternLM2
InternLM · legraphista
Params7.74B
Context256K
Smallest1.9 GB
GGUF
CH
K2-Chat
Chat · legraphista
Params65.3B
Context8K
Smallest14.2 GB
GGUF
RO
RoMistral-7b-Instruct
Romistral · legraphista
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mathstral-7B-v0.1
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
GGUF
QW
Qwen2 Math 72B Instruct
Qwen · legraphista
Params72.7B
Context4K
Smallest23.7 GB
GGUF
QW
Qwen2-57B-A14B-Instruct
Qwen · legraphista
Params57.4B
Context32K
Smallest39.6 GB
GGUF
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
RO
RoLlama2-7b-Chat
Rollama · legraphista
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
AY
aya-23-8B
Aya · legraphista
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
RO
RoLlama2-7b-Base
Rollama · legraphista
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing