GGUF models by legraphista

138 GGUF models quantized by legraphista on Hugging Face. Sizes run from 494M to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta-Llama-3-70B-Instruct-abliterated-v3.5
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
DE
DeepSeek-V2-Lite
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · legraphista
Params8B
Context8K
Smallest2.0 GB
GGUF
GE
Gemma 2 27b It
Gemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GGUF
PH
Phi 3 mini 4k instruct update2024 07 03 IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB
Coding
DE
DeepSeek-V2-Lite-Chat
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
GGUF
RO
RoMistral-7b-Instruct
Romistral · legraphista
Params7.24B
Context32K
Smallest1.6 GB
GGUF
GL
glm-4-9b-chat
GLM · legraphista
Params9.4B
Context128K
Smallest4.0 GB
GGUF
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
GGUF
PH
dolphin-2.9.2-Phi-3-Medium
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
CodingTool use
RO
RoLlama2-7b-Base
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB
GGUF
RO
RoLlama2-7b-Instruct
Rollama · legraphista
Params6.74B
Context4K
Smallest1.5 GB
GGUF
IN
InternLM2
InternLM · legraphista
Params7.74B
Context8K
Smallest1.9 GB
GGUF
IN
InternLM2
InternLM · legraphista
Params19.9B
Context8K
Smallest4.5 GB
GGUF
MI
Codestral 22B v0.1 IMat
Mistral · legraphista
Params22.2B
Context32K
Smallest4.8 GB
Coding
DE
DeepSeek V2.5
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
GGUF
XL
xLAM 8x7b R
Xlam · legraphista
Params46.7B
Context32K
Smallest9.8 GB
Tool use
LL
Hermes-2-Theta-Llama-3-8B
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
Tool use
DA
datagemma rig 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · legraphista
Params3.21B
Context128K
Smallest0.9 GB
GGUF
XL
xLAM 8x22b R
Xlam · legraphista
Params141B
Context64K
Smallest29.7 GB
Tool use
K2
K2-ckpt_360
legraphista
Params65B
Context2K
Smallest14.2 GB
GGUF
CO
C4Ai Command R Plus 08 2024
Command R · legraphista
Params104B
Context128K
Smallest23.2 GB
GGUF
QW
Qwen2-0.5B
Qwen · legraphista
Params494M
Context128K
Smallest0.3 GB
GGUF
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
GGUF
LL
dolphin-2.9.1-llama-3-8b
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
CodingTool use
CO
codegeex4-all-9b
Codegeex · legraphista
Params9.4B
Context128K
Smallest3.1 GB
GGUF
GE
gemma-2-9b-it
Gemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
GGUF
GR
Granite 20b Code Instruct
Granite · legraphista
Params20B
Context8K
Smallest4.5 GB
CodingTool use
QW
Qwen2-1.5B
Qwen · legraphista
Params1.54B
Context128K
Smallest0.4 GB
GGUF

About legraphista on Hugging Face

legraphista has published 138 GGUF models that ggufmodels.com tracks, across families such as Qwen, Llama and Mistral. The most downloaded are Meta-Llama-3-70B-Instruct-abliterated-v3.5, DeepSeek-V2-Lite and openchat-3.6-8b-20240522.

The quants legraphista publishes most often are Q8_0 (138), Q6_K (138), Q5_K_S (138) and Q5_K (138). Their Q4_K_M files range from 4.1 to 21.5 GB. Parameter counts run from 494M to 236B, and the longest trained context window is 1024K tokens.

Frequently asked questions

What GGUF models has legraphista published?

138 models are listed here, mainly from the Qwen, Llama and Mistral families. The most downloaded is Meta-Llama-3-70B-Instruct-abliterated-v3.5.

Which quants does legraphista publish?

The most common are Q8_0 (138 models), Q6_K (138 models), Q5_K_S (138 models) and Q5_K (138 models).

Keep browsing