GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
4yo1 Llama_1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Smaug Llama 3 70B Instruct abliterated v3
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
NU
NucleusOrg Nucleus 1B Alpha 1
Nucleus · tensorblock
Params1.13B
Context32K
Smallest0.5 GB
GGUF
QW
Qwen2.5 14B
Qwen · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
GGUF
QW
Qwen2.5 14B Gutenberg Instruct Slerpeno
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
Tool use
SM
smalllocal
Smalllocal · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
MI
mistral 7b 0 3 oh dcft v3.1 claude 3 5 sonnet 20241022
Mistral · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
GGUF
LL
Meta Llama Llama 3.1 70B Instruct
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
SU
L3.1 8B sunfall stheno v0.6.1
Sunfall · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
SW
Swallow 7b Instruct Hf
Swallow · tensorblock
Params6.83B
Context4K
Smallest2.6 GB
GGUF
SA
BSC LT Salamandra 2b Instruct
Salamandra · tensorblock
Params2.25B
Context8K
Smallest1.1 GB
Coding
LL
llama3 8B slerp med 262k
Llama · tensorblock
Params8.03B
Context256K
Smallest3.2 GB
GGUF
PI
Pinokio v1.0
Pinokio · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
FO
Tensoropera Fox 1 1.6B
Fox · tensorblock
Params1.67B
Context8K
Smallest0.9 GB
GGUF
LL
Nvidia Llama3 ChatQA 1.5 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
NI
MBZUAI Paris Nile Chat 4B
Nile · tensorblock
Params3.88B
Context128K
Smallest1.7 GB
GGUF
NE
NexoNimbus 7B
Nexonimbus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
cyber risk llama 3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Vision
SQ
defog sqlcoder 7b
Sqlcoder · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
LL
RLHFlow LLaMA3 SFT v2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SY
Synatra TbST02M IN01
Synatra · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
QW
Qwen2 7B Instruct
Qwen · tensorblock
Params7.61B
Context32K
Smallest3.0 GB
GGUF
MI
Mistral 7B Instruct RDPO
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
calme-2.2-qwen2-7b
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
SE
SeaLLMs SeaLLMs v3 7B Chat
Seallms · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
GGUF
QW
Qwen2.5 Coder 7B
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Coding
MI
Dolphin 2.6 Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SO
PracticeLLM SOLAR Tail 10.7B Instruct v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF

Keep browsing