GGUF models by legraphista
138 GGUF models quantized by legraphista on Hugging Face. Sizes run from 494M to 236B parameters. The longest trained context is 1024K tokens.
NU
NuminaMath-7B-TIR
Numinamath · legraphista
Params6.91B
Context4K
Smallest1.7 GB
MI
Mistral-7B-v0.3
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
GE
Gemma 2 2b
Gemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
MI
Minitron 4B Base
Minitron · legraphista
Params4.19B
Context4K
Smallest1.9 GB
LL
llm-compiler-7b-ftd
Llm · legraphista
Params6.74B
Context16K
Smallest1.5 GB
QW
Qwen2-57B-A14B-Instruct
Qwen · legraphista
Params57.4B
Context32K
Smallest21.1 GB
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
LL
Meta Llama 3.1 70B Instruct
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
QW
Qwen2.5 14B Instruct
Qwen · legraphista
Params14.8B
Context32K
Smallest3.6 GB
QW
Qwen2.5 1.5B Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
LL
Higgs-Llama-3-70B
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
RE
reader lm 0.5b IMat
Reader · legraphista
Params494M
Context250K
Smallest0.3 GB
LL
Llama 3.1 Storm 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
MI
Mistral NeMo Minitron 8B Base
Mistral · legraphista
Params8.41B
Context8K
Smallest2.1 GB
QW
Qwen2.5 3B Instruct
Qwen · legraphista
Params3.09B
Context32K
Smallest0.8 GB
PH
Phi 3 medium 4k instruct IMat
Phi · legraphista
Params14B
Context4K
Smallest3.0 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
MI
Minitron 8B Base
Minitron · legraphista
Params8.27B
Context4K
Smallest3.6 GB
QW
Qwen2.5 7B Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
XL
xLAM 7b R
Xlam · legraphista
Params7.24B
Context32K
Smallest1.6 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
QW
Qwen2.5 72B Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest23.7 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · legraphista
Params4.51B
Context128K
Smallest1.8 GB
LL
Llama 3.1 SuperNova Lite
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Smallest8.5 GB
AU
AutoCoder
Autocoder · legraphista
Params33.3B
Context16K
Smallest7.2 GB
SH
Shieldgemma 27b
Shieldgemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
DA
datagemma rag 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
YI
Yi-9B-Coder
Yi · legraphista
Params8.83B
Context4K
Smallest2.0 GB
PH
Phi 3 mini 4k instruct IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB