GGUF models by legraphista

138 GGUF models quantized by legraphista on Hugging Face. Sizes run from 494M to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NU
NuminaMath-7B-TIR
Numinamath · legraphista
Params6.91B
Context4K
Smallest1.7 GB
GGUF
MI
Mistral-7B-v0.3
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
GGUF
GE
Gemma 2 2b
Gemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
GGUF
MI
Minitron 4B Base
Minitron · legraphista
Params4.19B
Context4K
Smallest1.9 GB
GGUF
LL
llm-compiler-7b-ftd
Llm · legraphista
Params6.74B
Context16K
Smallest1.5 GB
GGUF
QW
Qwen2-57B-A14B-Instruct
Qwen · legraphista
Params57.4B
Context32K
Smallest21.1 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · legraphista
Params15.7B
Context160K
Smallest5.0 GB
Coding
LL
Meta Llama 3.1 70B Instruct
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
GGUF
QW
Qwen2.5 14B Instruct
Qwen · legraphista
Params14.8B
Context32K
Smallest3.6 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
GGUF
LL
Higgs-Llama-3-70B
Llama · legraphista
Params70.6B
Context8K
Smallest15.3 GB
GGUF
RE
reader lm 0.5b IMat
Reader · legraphista
Params494M
Context250K
Smallest0.3 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
Reasoning
MI
Mistral NeMo Minitron 8B Base
Mistral · legraphista
Params8.41B
Context8K
Smallest2.1 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · legraphista
Params3.09B
Context32K
Smallest0.8 GB
Tool use
PH
Phi 3 medium 4k instruct IMat
Phi · legraphista
Params14B
Context4K
Smallest3.0 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
GGUF
MI
Minitron 8B Base
Minitron · legraphista
Params8.27B
Context4K
Smallest3.6 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
Tool use
XL
xLAM 7b R
Xlam · legraphista
Params7.24B
Context32K
Smallest1.6 GB
Tool use
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
CodingTool use
QW
Qwen2.5 72B Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest23.7 GB
Tool use
LL
Llama 3.1 Minitron 4B Width Base
Llama · legraphista
Params4.51B
Context128K
Smallest1.8 GB
GGUF
LL
Llama 3.1 SuperNova Lite
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
GGUF
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Smallest8.5 GB
GGUF
AU
AutoCoder
Autocoder · legraphista
Params33.3B
Context16K
Smallest7.2 GB
Coding
SH
Shieldgemma 27b
Shieldgemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GGUF
DA
datagemma rag 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GGUF
YI
Yi-9B-Coder
Yi · legraphista
Params8.83B
Context4K
Smallest2.0 GB
Coding
PH
Phi 3 mini 4k instruct IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB
GGUF

Keep browsing