GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
ldm_soup_Llama 3.1 8B Inst
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Uukuguy Speechless Codellama Dolphin Orca Platypus 13b
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
Coding
BA
Bagel Dpo 34b v0.2
Bagel · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
CodingRoleplay
LL
Llama 2 7b ultrachat200k 2e
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
SY
Migtissera SynthIA 7B v1.3
Synthia · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
hfl chinese llama 2 13b
Llama · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
GGUF
LL
Llama2.C stories15M
Llama · tensorblock
Params—
Context256
Smallest0.0 GB
GGUF
QW
BAAI Infinity Instruct 3M 0625 Qwen2 7B
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
GGUF
LL
Yeonwoo780 Cydinfo Llama3 8b Lora v01
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OR
OrionStarAI Orion 14B Chat RAG
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
Coding
WE
WestLake 7B v2 Laser
Westlake · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
VI
Vicuna 13b v1.5
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · tensorblock
Params21M
Context128K
Smallest0.0 GB
Tool use
LL
ChocoLlama Llama 3 ChocoLlama 8B instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SO
I SOLAR 10.7B dpo sft v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
DI
Marcoro14 7B Slerp
Distilabeled · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AP
Apollo 0.5B
Apollo · tensorblock
Params464M
Context32K
Smallest0.2 GB
GGUF
MI
Mistral 14b Merge Base
Mistral · tensorblock
Params14.2B
Context32K
Smallest5.3 GB
GGUF
NE
nvidia Nemotron Mini 4B Instruct
Nemotron · tensorblock
Params4.19B
Context4K
Smallest1.9 GB
Tool use
PE
Peagle 9b
Peagle · tensorblock
Params8.99B
Context32K
Smallest3.4 GB
GGUF
LE
DeepMount00 Lexora Lite 3B
Lexora · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
LL
ELYZA Japanese Llama 2 7b
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
HK
hkcode solar youtube merged
Hkcode · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
Llama 3.1 8B SuperNova EtherealHermes
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
CO
CohereLabs C4Ai Command R 08 2024
Command R · tensorblock
Params32.3B
Context128K
Smallest12.8 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MA
macaroni 7b
Macaroni · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama 3.1 ARC Heavy Transduction 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Configurable Llama 3 8B v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SO
Tanitan2 SOLAR 10.7B Instruct STOCK_SOLAR Slerp
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF

Keep browsing