GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
ldm_soup_Llama 3.1 8B Inst
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Uukuguy Speechless Codellama Dolphin Orca Platypus 13b
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
BA
Bagel Dpo 34b v0.2
Bagel · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
LL
Llama 2 7b ultrachat200k 2e
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
SY
Migtissera SynthIA 7B v1.3
Synthia · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
hfl chinese llama 2 13b
Llama · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
LL
Llama2.C stories15M
Llama · tensorblock
Params—
Context256
Smallest0.0 GB
QW
BAAI Infinity Instruct 3M 0625 Qwen2 7B
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
LL
Yeonwoo780 Cydinfo Llama3 8b Lora v01
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OR
OrionStarAI Orion 14B Chat RAG
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
WE
WestLake 7B v2 Laser
Westlake · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
VI
Vicuna 13b v1.5
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Llama 3.2 3B Instruct
Llama · tensorblock
Params21M
Context128K
Smallest0.0 GB
LL
ChocoLlama Llama 3 ChocoLlama 8B instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SO
I SOLAR 10.7B dpo sft v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
DI
Marcoro14 7B Slerp
Distilabeled · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AP
Apollo 0.5B
Apollo · tensorblock
Params464M
Context32K
Smallest0.2 GB
MI
Mistral 14b Merge Base
Mistral · tensorblock
Params14.2B
Context32K
Smallest5.3 GB
NE
nvidia Nemotron Mini 4B Instruct
Nemotron · tensorblock
Params4.19B
Context4K
Smallest1.9 GB
PE
Peagle 9b
Peagle · tensorblock
Params8.99B
Context32K
Smallest3.4 GB
LE
DeepMount00 Lexora Lite 3B
Lexora · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
LL
ELYZA Japanese Llama 2 7b
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
HK
hkcode solar youtube merged
Hkcode · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
Llama 3.1 8B SuperNova EtherealHermes
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
CO
CohereLabs C4Ai Command R 08 2024
Command R · tensorblock
Params32.3B
Context128K
Smallest12.8 GB
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MA
macaroni 7b
Macaroni · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 3.1 ARC Heavy Transduction 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Configurable Llama 3 8B v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SO
Tanitan2 SOLAR 10.7B Instruct STOCK_SOLAR Slerp
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB