GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Llama 3 Debug
Llama · tensorblock
Params17M
Context8K
Smallest0.0 GB
AR
Arch Function 7B
Arch · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
QW
Qwen Qwen2 VL 7B
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
LL
Meta Llama 3 8B Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MA
MARS
Mars · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Meta Llama 3 8B Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OP
OpenMistral MoE
Openmistral · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
PY
EleutherAI Pythia 410m Deduped
Pythia · tensorblock
Params405M
Context2K
Smallest0.2 GB
OM
Omni Reasoner2 Merged
Omni · tensorblock
Params14.7B
Context16K
Smallest5.6 GB
QW
Vikhr-Qwen-2.5-0.5b-Instruct
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
DE
Deepseek Ai Deepseek Math 7b Rl
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
LL
Llama 3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
VI
Luckychao Vicuna Backdoored 7B
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
PL
ko platypus kiwi 13B
Platypus · tensorblock
Params13B
Context2K
Smallest4.9 GB
PY
EleutherAI Pythia 2.8b
Pythia · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
KA
Karakuri Lm 8x7b Instruct v0.1
Karakuri · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
CH
jeiku Chaos RP l3 8B
Chaos · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Open Orca Mistral 7B OpenOrca
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
KISTI KONI KONI Llama3.1 8B Instruct 20241024
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
TA
prithivMLmods Tadpole Opus 14B Exp
Tadpole · tensorblock
Params14.8B
Context986K
Smallest5.8 GB
QW
Qwq Bakeneko 32b
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
QW
Huihui Ai QwQ 32B Coder Fusion 9010
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
TH
PKU ONELab Themis
Themis · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GI
Abacusai Giraffe 13b 32k v3
Giraffe · tensorblock
Params13B
Context32K
Smallest4.9 GB
SA
Salamandra 7b Instruct
Salamandra · tensorblock
Params7.77B
Context8K
Smallest3.3 GB
GE
INSAIT Institute BgGPT Gemma 2 2.6B IT v1.0
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
LL
Llama 3.2 3B Instruct Medical Conversational
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
GE
Mlabonne Gemma 3 12b It Abliterated v2
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
BR
ReadyArt Broken Tutu 24B Unslop v2.0
Broken · tensorblock
Params23.6B
Context32K
Smallest8.9 GB