GGUF models by legraphista
138 GGUF models quantized by legraphista on Hugging Face. Sizes run from 494M to 236B parameters. The longest trained context is 1024K tokens.
LL
Llama Guard 3 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
QW
Qwen2-1.5B-Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
RO
RoLlama3-8b-Instruct
Rollama · legraphista
Params8B
Context8K
Smallest2.0 GB
PA
Palmyra Fin 70B 32K
Palmyra · legraphista
Params70.6B
Context32K
Smallest15.3 GB
SH
Shieldgemma 2b
Shieldgemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
LL
Llama3-ChatQA-1.5-8B
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
NX
Nxcode-CQ-7B-orpo
Nxcode · legraphista
Params7.25B
Context64K
Smallest2.4 GB
LL
Hermes 3 Llama 3.1 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
PH
Unsloth Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.9 GB
RO
RoGemma-7b-Instruct
Rogemma · legraphista
Params8.54B
Context8K
Smallest2.2 GB
QW
Qwen2-7B
Qwen · legraphista
Params7.62B
Context128K
Smallest1.9 GB
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
QW
Qwen2 Math 1.5B Instruct
Qwen · legraphista
Params1.54B
Context4K
Smallest0.4 GB
IN
InternLM2
InternLM · legraphista
Params1.89B
Context8K
Smallest0.5 GB
GL
glm-4-9b-chat
GLM · legraphista
Params9.4B
Context128K
Smallest3.1 GB
YU
Yuan2 M32 hf IMat
Yuan · legraphista
Params40.2B
Context4K
Smallest8.7 GB
LL
Llama-3-8B-Instruct-MopeyMule
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
QW
Qwen2-7B-Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
LL
Hermes 3 Llama 3.1 70B
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
NE
neo_7b_instruct_v0.1
Neo · legraphista
Params7.79B
Context8K
Smallest1.7 GB
AY
aya-23-8B
Aya · legraphista
Params8B
Context8K
Smallest2.2 GB
LL
Llama 3.2 1B Instruct
Llama · legraphista
Params1.24B
Context128K
Smallest0.4 GB
QW
Qwen2-0.5B-Instruct
Qwen · legraphista
Params494M
Context32K
Smallest0.3 GB
QW
Qwen2.5 0.5B Instruct
Qwen · legraphista
Params494M
Context32K
Smallest0.3 GB
AT
Athene 70B
Athene · legraphista
Params70.6B
Context8K
Smallest15.3 GB
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · legraphista
Params22.2B
Context64K
Smallest4.8 GB
LL
dolphin-2.9.1-llama-3-70b
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
MI
internlm2-math-plus-mixtral8x22b
Mistral · legraphista
Params141B
Context64K
Smallest29.6 GB