GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
MI
Mistral 7B OpenOrca
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DE
de v3.1
tensorblock
Params8.03B
Context128K
Smallest3.2 GB
PL
Platypus 30B
Platypus · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
QW
Qwen2.5 7B Nerd Uncensored v1.0
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
YI
Hyeogi Yi 6b Dpo v0.4
Yi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
LL
Nvidia Llama3 ChatQA 1.5 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
FA
H2Oai H2Ogpt Gm Oasst1 En 2048 Falcon 7b v2
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
LL
KISTI KONI KONI Llama3 8B 20240630
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
UN
Ajibawa 2023 Uncensored Jordan 13B
Uncensored · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
ko llama2 finetune ex4
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GE
MergeBench Gemma 2 9b It Gemma 2 9b It GRPO After Sft
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
PH
Tess v2.5 Phi 3 medium 128k 14B
Phi · tensorblock
Params14B
Context128K
Smallest5.1 GB
LL
llama2 7b n ox test v1
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
QW
qwen2.5-3b-sft-10
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
LL
Hobbesleland CodeLlama 7b Instruct Hf
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
TI
tinyllama review summary
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
IT
ITT Yi Ko 6B v2.0
Itt · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
RO
L3 8b Rosier v1
Rosier · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
CHIH HUNG llama 2 13b FINETUNE3 3.3w r8 gate up down
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
MP
Mosaicml Mpt 7b 8k
Mpt · tensorblock
Params6.65B
Context8K
Smallest2.6 GB
DA
L3 DARKEST PLANET 16.5B
Darkest · tensorblock
Params16.5B
Context8K
Smallest6.3 GB
MI
OpenBuddy openbuddy mistral 7b v13 base
Mistral · tensorblock
Params7.28B
Context32K
Smallest2.7 GB
OR
Orca 2 13b SFT v6
Orca · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Meta Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
TO
Unbabel TowerBase 13B v0.1
Towerbase · tensorblock
Params13B
Context4K
Smallest4.9 GB
GL
Allura Org GLM4 9B Neon v2
GLM · tensorblock
Params9.4B
Context32K
Smallest4.0 GB
AG
Aguie chat v0.1
Aguie · tensorblock
Params13.3B
Context2K
Smallest5.0 GB
CA
Doctor Shotgun CalliopeDS v2 L2 13B
Calliopeds · tensorblock
Params13B
Context4K
Smallest4.9 GB
GE
GeM2 Llamion 14B Chat
Gem · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
WI
vanillaOVO WizardMath 13B V1.0
Wizardmath · tensorblock
Params13B
Context4K
Smallest4.9 GB