GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
4yo1 Llama_1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Smaug Llama 3 70B Instruct abliterated v3
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
NU
NucleusOrg Nucleus 1B Alpha 1
Nucleus · tensorblock
Params1.13B
Context32K
Smallest0.5 GB
QW
Qwen2.5 14B
Qwen · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
QW
Qwen2.5 14B Gutenberg Instruct Slerpeno
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
SM
smalllocal
Smalllocal · tensorblock
Params163M
Context1K
Smallest0.1 GB
MI
mistral 7b 0 3 oh dcft v3.1 claude 3 5 sonnet 20241022
Mistral · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
LL
Meta Llama Llama 3.1 70B Instruct
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
SU
L3.1 8B sunfall stheno v0.6.1
Sunfall · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
SW
Swallow 7b Instruct Hf
Swallow · tensorblock
Params6.83B
Context4K
Smallest2.6 GB
SA
BSC LT Salamandra 2b Instruct
Salamandra · tensorblock
Params2.25B
Context8K
Smallest1.1 GB
LL
llama3 8B slerp med 262k
Llama · tensorblock
Params8.03B
Context256K
Smallest3.2 GB
PI
Pinokio v1.0
Pinokio · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
FO
Tensoropera Fox 1 1.6B
Fox · tensorblock
Params1.67B
Context8K
Smallest0.9 GB
LL
Nvidia Llama3 ChatQA 1.5 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Mistral 7B Instruct v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NI
MBZUAI Paris Nile Chat 4B
Nile · tensorblock
Params3.88B
Context128K
Smallest1.7 GB
NE
NexoNimbus 7B
Nexonimbus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
cyber risk llama 3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SQ
defog sqlcoder 7b
Sqlcoder · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SA
SauerkrautLM Nemo 12b Instruct
Sauerkrautlm · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
LL
RLHFlow LLaMA3 SFT v2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SY
Synatra TbST02M IN01
Synatra · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
QW
Qwen2 7B Instruct
Qwen · tensorblock
Params7.61B
Context32K
Smallest3.0 GB
MI
Mistral 7B Instruct RDPO
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
calme-2.2-qwen2-7b
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
SE
SeaLLMs SeaLLMs v3 7B Chat
Seallms · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
QW
Qwen2.5 Coder 7B
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
MI
Dolphin 2.6 Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SO
PracticeLLM SOLAR Tail 10.7B Instruct v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB