GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LI
Qihoo360 Light R1 32B DS
Light · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
WI
TheBloke Wizard Vicuna 30B Uncensored Fp16
Wizard · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
LL
llama2 merge v0.2
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
QW
Qwen2.5 Lumen 14B
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
LL
llama 2 7b miniguanaco
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
WA
Wayfarer 12b
Wayfarer · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
DE
asm2asm deepseek 1.3b 500k 4ep x86 O0 arm gnueabi gcc
DeepSeek · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
LL
llama 161M 100B
Llama · tensorblock
Params162M
Context1K
Smallest0.1 GB
CM
CM 14
tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MC
Mci29 Sn29_Dec_05
Mci · tensorblock
Params8.99B
Context4K
Smallest3.8 GB
SW
SwallowMaid 8B L3 SPPO abliterated
Swallowmaid · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SO
SOLAR Tail 10.7B
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
DI
Josephgflowers distillgpt2Cinder
Distillgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
LL
Llama3 8b Instruct Summary
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
WE
WestSeverus 7B
Westseverus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
PiVoT 10.7B Mistral v0.2 RP
Mistral · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
LL
Kyujinpy PlatYi 34B Llama Q v3
Llama · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
IN
Internlm Internlm2_5 7b
InternLM · tensorblock
Params7.74B
Context256K
Smallest3.0 GB
EX
Locutusque lr experiment1 7B
Experiment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
KN
Mobeen0 Knowlithic 0.4
Knowlithic · tensorblock
Params507M
Context32K
Smallest0.4 GB
OP
OPEN SOLAR KO 10.7B
Open · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
LL
Arabic Orpo Llama 3 8B Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Bllossom Llama 3.2 Korean Bllossom 3B
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
LL
Llama 3.1 ARC Potpourri Induction 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MR
MrRobotoAI 110
tensorblock
Params8.03B
Context1024K
Smallest3.2 GB
LL
Llama 3.2 3B
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
LL
Llama 2 Ko Instruct 13B
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
LL
Erdem Erdem Llama3.2 3b It 24 Game 8k Qwq R64
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
TA
danielkty22 TARS SFT 1.5B
Tars · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
MI
bun mistral 7b v2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB