GGUF models by legraphista
138 GGUF models quantized by legraphista on Hugging Face. Sizes run from 494M to 236B parameters. The longest trained context is 1024K tokens.
IN
Internlm2_5 1_8b Chat
InternLM · legraphista
Params1.89B
Context32K
Smallest0.5 GB
GE
Gemma 2 2b It
Gemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
PH
Phi 3 mini 128k instruct IMat
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
CO
Yi Coder 9B Chat
Coder · legraphista
Params8.83B
Context128K
Smallest2.0 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
RE
reader lm 1.5b IMat
Reader · legraphista
Params1.54B
Context250K
Smallest0.4 GB
NE
neo_7b_sft_v0.1
Neo · legraphista
Params7.79B
Context8K
Smallest1.7 GB
QW
Qwen2.5 32B Instruct
Qwen · legraphista
Params32.8B
Context32K
Smallest7.3 GB
QW
Qwen2.5 Math 7B Instruct
Qwen · legraphista
Params7.62B
Context4K
Smallest1.9 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · legraphista
Params1.54B
Context4K
Smallest0.4 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
NE
neo 7b IMat
Neo · legraphista
Params7.79B
Context8K
Smallest1.7 GB
IN
Internlm2_5 20b Chat
InternLM · legraphista
Params19.9B
Context32K
Smallest4.5 GB
K2
K2 IMat
legraphista
Params65.3B
Context2K
Smallest14.2 GB
CO
Yi Coder 9B
Coder · legraphista
Params8.83B
Context128K
Smallest2.0 GB
RO
RoLlama2-7b-Chat
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB
PH
Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
LL
Reflection Llama 3.1 70B IMat
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GL
glm-4-9b-chat-1m
GLM · legraphista
Params9.48B
Context1024K
Smallest4.0 GB
MI
Mistral Large Instruct 2407
Mistral · legraphista
Params123B
Context32K
Smallest26.0 GB
IN
InternLM2
InternLM · legraphista
Params7.74B
Context32K
Smallest1.9 GB
MI
Mistral Nemo Instruct 2407
Mistral · legraphista
Params12.2B
Context1000K
Smallest3.0 GB
LL
llm-compiler-13b
Llm · legraphista
Params13B
Context16K
Smallest2.9 GB
LL
llm-compiler-13b-ftd
Llm · legraphista
Params13B
Context16K
Smallest2.9 GB
LL
Llama-3-Instruct-8B-SimPO
Llama · legraphista
Params8.03B
Context8K
Smallest2.0 GB
LL
llm-compiler-7b
Llm · legraphista
Params6.74B
Context16K
Smallest1.5 GB
PH
Phi 3 medium 128k instruct IMat
Phi · legraphista
Params14B
Context128K
Smallest3.0 GB