GGUF models by legraphista

138 GGUF models quantized by legraphista on Hugging Face. Sizes run from 494M to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
Internlm2_5 1_8b Chat
InternLM · legraphista
Params1.89B
Context32K
Smallest0.5 GB
GGUF
GE
Gemma 2 2b It
Gemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
GGUF
PH
Phi 3 mini 128k instruct IMat
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
GGUF
DE
DeepSeek Coder V2 Instruct 0724
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
CodingTool use
CO
Yi Coder 9B Chat
Coder · legraphista
Params8.83B
Context128K
Smallest2.0 GB
Coding
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
CodingTool use
RE
reader lm 1.5b IMat
Reader · legraphista
Params1.54B
Context250K
Smallest0.4 GB
GGUF
NE
neo_7b_sft_v0.1
Neo · legraphista
Params7.79B
Context8K
Smallest1.7 GB
GGUF
QW
Qwen2.5 32B Instruct
Qwen · legraphista
Params32.8B
Context32K
Smallest7.3 GB
Tool use
QW
Qwen2.5 Math 7B Instruct
Qwen · legraphista
Params7.62B
Context4K
Smallest1.9 GB
Tool use
QW
Qwen2.5 Coder 7B Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
CodingTool use
LL
Meta Llama 3.1 8B Instruct
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
GGUF
QW
Qwen2.5 Math 1.5B Instruct
Qwen · legraphista
Params1.54B
Context4K
Smallest0.4 GB
Tool use
MI
Mistral-7B-Instruct-v0.3
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
GGUF
NE
neo 7b IMat
Neo · legraphista
Params7.79B
Context8K
Smallest1.7 GB
GGUF
IN
Internlm2_5 20b Chat
InternLM · legraphista
Params19.9B
Context32K
Smallest4.5 GB
GGUF
K2
K2 IMat
legraphista
Params65.3B
Context2K
Smallest14.2 GB
GGUF
CO
Yi Coder 9B
Coder · legraphista
Params8.83B
Context128K
Smallest2.0 GB
Coding
RO
RoLlama2-7b-Chat
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
Coding
LL
Reflection Llama 3.1 70B IMat
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
GL
glm-4-9b-chat-1m
GLM · legraphista
Params9.48B
Context1024K
Smallest4.0 GB
GGUF
MI
Mistral Large Instruct 2407
Mistral · legraphista
Params123B
Context32K
Smallest26.0 GB
GGUF
IN
InternLM2
InternLM · legraphista
Params7.74B
Context32K
Smallest1.9 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · legraphista
Params12.2B
Context1000K
Smallest3.0 GB
GGUF
LL
llm-compiler-13b
Llm · legraphista
Params13B
Context16K
Smallest2.9 GB
GGUF
LL
llm-compiler-13b-ftd
Llm · legraphista
Params13B
Context16K
Smallest2.9 GB
GGUF
LL
Llama-3-Instruct-8B-SimPO
Llama · legraphista
Params8.03B
Context8K
Smallest2.0 GB
GGUF
LL
llm-compiler-7b
Llm · legraphista
Params6.74B
Context16K
Smallest1.5 GB
GGUF
PH
Phi 3 medium 128k instruct IMat
Phi · legraphista
Params14B
Context128K
Smallest3.0 GB
GGUF

Keep browsing