GGUF models by legraphista

138 GGUF models quantized by legraphista on Hugging Face. Sizes run from 494M to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama Guard 3 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
GGUF
QW
Qwen2-1.5B-Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
GGUF
RO
RoLlama3-8b-Instruct
Rollama · legraphista
Params8B
Context8K
Smallest2.0 GB
GGUF
PA
Palmyra Fin 70B 32K
Palmyra · legraphista
Params70.6B
Context32K
Smallest15.3 GB
GGUF
SH
Shieldgemma 2b
Shieldgemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
GGUF
LL
Llama3-ChatQA-1.5-8B
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
GGUF
NX
Nxcode-CQ-7B-orpo
Nxcode · legraphista
Params7.25B
Context64K
Smallest2.4 GB
Coding
LL
Hermes 3 Llama 3.1 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
RoleplayTool use
PH
Unsloth Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.9 GB
GGUF
RO
RoGemma-7b-Instruct
Rogemma · legraphista
Params8.54B
Context8K
Smallest2.2 GB
GGUF
QW
Qwen2-7B
Qwen · legraphista
Params7.62B
Context128K
Smallest1.9 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
Coding
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
GGUF
QW
Qwen2 Math 1.5B Instruct
Qwen · legraphista
Params1.54B
Context4K
Smallest0.4 GB
GGUF
IN
InternLM2
InternLM · legraphista
Params1.89B
Context8K
Smallest0.5 GB
GGUF
GL
glm-4-9b-chat
GLM · legraphista
Params9.4B
Context128K
Smallest3.1 GB
GGUF
YU
Yuan2 M32 hf IMat
Yuan · legraphista
Params40.2B
Context4K
Smallest8.7 GB
GGUF
LL
Llama-3-8B-Instruct-MopeyMule
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
GGUF
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
Coding
QW
Qwen2-7B-Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
GGUF
LL
Hermes 3 Llama 3.1 70B
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
RoleplayTool use
NE
neo_7b_instruct_v0.1
Neo · legraphista
Params7.79B
Context8K
Smallest1.7 GB
GGUF
AY
aya-23-8B
Aya · legraphista
Params8B
Context8K
Smallest2.2 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · legraphista
Params1.24B
Context128K
Smallest0.4 GB
GGUF
QW
Qwen2-0.5B-Instruct
Qwen · legraphista
Params494M
Context32K
Smallest0.3 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · legraphista
Params494M
Context32K
Smallest0.3 GB
GGUF
AT
Athene 70B
Athene · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · legraphista
Params22.2B
Context64K
Smallest4.8 GB
CodingTool use
LL
dolphin-2.9.1-llama-3-70b
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
CodingTool use
MI
internlm2-math-plus-mixtral8x22b
Mistral · legraphista
Params141B
Context64K
Smallest29.6 GB
GGUF

Keep browsing