GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
fireworks ai llama 3 firefunction v2
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
Tool use
GP
Demo Leaderboard Gpt2 Demo
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
LL
Llama 3 8B Magpie Align SFT v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Reasoning
VI
vicuna class student all hal 7b
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
CH
CHEMLLM 2b 1_5
Chemllm · tensorblock
Params1.89B
Context32K
Smallest0.8 GB
GGUF
MI
mistral nemo wissenschaft 12B
Mistral · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
Tool use
EN
Oopsung Yi Ko ENC v1
Enc · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
LL
Llama 3 70B Instruct Gradient 1048k
Llama · tensorblock
Params70.6B
Context1024K
Smallest26.4 GB
GGUF
MA
Maral 7B alpha 1
Maral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
HE
Weyaxi HelpSteer Filtered Solar Instruct
Helpsteer · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
Llama3.1 8B ShiningValiant2
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
GE
ModelSpace GemmaX2 28 9B Pretrain
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
DA
DaringMaid 20B
Daringmaid · tensorblock
Params20B
Context4K
Smallest7.4 GB
GGUF
LL
llama2 chat koalpaca
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
KBNIT Llama 3 8B Kolon ITD 5 v1.0
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
AB
GAIR Abel 7B 002
Abel · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SU
DISLab SummLlama3.1 8B
Summllama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
DI
dictalm2 it qa fine tune
Dictalm · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
GGUF
NA
nnpy Nape 0
Nape · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
MI
BAAI Infinity Instruct 3M 0613 Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Ericpolewski AIRIC The Mistral
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
FI
RWKV v6 Finch 14B HF
Finch · tensorblock
Params14.1B
Context1024K
Smallest5.6 GB
GGUF
MI
Mixtral 7Bx2 MoE
Mistral · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
GGUF
GP
GPT2 PMC
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
YI
Brucethemoose Capybara Tess Yi 34B 200K
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
MI
mistral 7b anthropic
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
C10X LongWriter Qwen2.5 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
LL
Vedant3907 Text to Sql llama3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama3 8B DarkIdol 2.2 Uncensored 1048K B
Llama · tensorblock
Params8.03B
Context1024K
Smallest3.2 GB
Roleplay
QW
Unsloth Qwen3 0.6B Base
Qwen · tensorblock
Params596M
Context32K
Smallest0.3 GB
GGUF

Keep browsing