GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
fireworks ai llama 3 firefunction v2
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GP
Demo Leaderboard Gpt2 Demo
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
LL
Llama 3 8B Magpie Align SFT v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
VI
vicuna class student all hal 7b
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
CH
CHEMLLM 2b 1_5
Chemllm · tensorblock
Params1.89B
Context32K
Smallest0.8 GB
MI
mistral nemo wissenschaft 12B
Mistral · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
EN
Oopsung Yi Ko ENC v1
Enc · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
LL
Llama 3 70B Instruct Gradient 1048k
Llama · tensorblock
Params70.6B
Context1024K
Smallest26.4 GB
MA
Maral 7B alpha 1
Maral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
HE
Weyaxi HelpSteer Filtered Solar Instruct
Helpsteer · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
Llama3.1 8B ShiningValiant2
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GE
ModelSpace GemmaX2 28 9B Pretrain
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
DA
DaringMaid 20B
Daringmaid · tensorblock
Params20B
Context4K
Smallest7.4 GB
LL
llama2 chat koalpaca
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
KBNIT Llama 3 8B Kolon ITD 5 v1.0
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
AB
GAIR Abel 7B 002
Abel · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SU
DISLab SummLlama3.1 8B
Summllama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
DI
dictalm2 it qa fine tune
Dictalm · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
NA
nnpy Nape 0
Nape · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
MI
BAAI Infinity Instruct 3M 0613 Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Ericpolewski AIRIC The Mistral
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
FI
RWKV v6 Finch 14B HF
Finch · tensorblock
Params14.1B
Context1024K
Smallest5.6 GB
MI
Mixtral 7Bx2 MoE
Mistral · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
GP
GPT2 PMC
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
YI
Brucethemoose Capybara Tess Yi 34B 200K
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
MI
mistral 7b anthropic
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
C10X LongWriter Qwen2.5 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
LL
Vedant3907 Text to Sql llama3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama3 8B DarkIdol 2.2 Uncensored 1048K B
Llama · tensorblock
Params8.03B
Context1024K
Smallest3.2 GB
QW
Unsloth Qwen3 0.6B Base
Qwen · tensorblock
Params596M
Context32K
Smallest0.3 GB