GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B OpenOrca
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DE
de v3.1
tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
PL
Platypus 30B
Platypus · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
GGUF
QW
Qwen2.5 7B Nerd Uncensored v1.0
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
YI
Hyeogi Yi 6b Dpo v0.4
Yi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
LL
Nvidia Llama3 ChatQA 1.5 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
FA
H2Oai H2Ogpt Gm Oasst1 En 2048 Falcon 7b v2
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
GGUF
LL
KISTI KONI KONI Llama3 8B 20240630
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
UN
Ajibawa 2023 Uncensored Jordan 13B
Uncensored · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
ko llama2 finetune ex4
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
GE
MergeBench Gemma 2 9b It Gemma 2 9b It GRPO After Sft
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · tensorblock
Params14B
Context128K
Smallest5.1 GB
GGUF
LL
llama2 7b n ox test v1
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
QW
qwen2.5-3b-sft-10
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
GGUF
LL
Hobbesleland CodeLlama 7b Instruct Hf
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
TI
tinyllama review summary
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
IT
ITT Yi Ko 6B v2.0
Itt · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
RO
L3 8b Rosier v1
Rosier · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
CHIH HUNG llama 2 13b FINETUNE3 3.3w r8 gate up down
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
MP
Mosaicml Mpt 7b 8k
Mpt · tensorblock
Params6.65B
Context8K
Smallest2.6 GB
GGUF
DA
L3 DARKEST PLANET 16.5B
Darkest · tensorblock
Params16.5B
Context8K
Smallest6.3 GB
GGUF
MI
OpenBuddy openbuddy mistral 7b v13 base
Mistral · tensorblock
Params7.28B
Context32K
Smallest2.7 GB
GGUF
OR
Orca 2 13b SFT v6
Orca · tensorblock
Params13B
Context4K
Smallest4.9 GB
Coding
LL
Meta Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
TO
Unbabel TowerBase 13B v0.1
Towerbase · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
GL
Allura Org GLM4 9B Neon v2
GLM · tensorblock
Params9.4B
Context32K
Smallest4.0 GB
Tool use
AG
Aguie chat v0.1
Aguie · tensorblock
Params13.3B
Context2K
Smallest5.0 GB
GGUF
CA
Doctor Shotgun CalliopeDS v2 L2 13B
Calliopeds · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
GE
GeM2 Llamion 14B Chat
Gem · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
GGUF
WI
vanillaOVO WizardMath 13B V1.0
Wizardmath · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF

Keep browsing