GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Meta Llama Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama3 TenyxChat 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
LL
Huggyllama Llama 7b
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
QW
Mlabonne Qwen3 8B Abliterated
Qwen · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
VI
Vicuna 7b v1.3
Vicuna · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
BA
Barcenas Tiny 1.1b DPO
Barcenas · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
DI
Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
ST
L3 8B Stheno v3.3 32K
Stheno · tensorblock
Params8.03B
Context32K
Smallest3.2 GB
GH
Ghost 8b Beta
Ghost · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GR
Ibm Granite Granite 3.0 1b A400M Base
Granite · tensorblock
Params1.38B
Context4K
Smallest0.5 GB
QW
Qwen2 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
ES
EstopianMaid 13B
Estopianmaid · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Llama 3.1 Tulu 3 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Onnx Internal Testing Tiny Random LlamaForCausalLM Untied
Llama · tensorblock
Params8M
Context128K
Smallest0.0 GB
ZE
UCLA AGI Zephyr 7b Sft Full SPIN Iter2
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DA
DavidAU MN DARKEST UNIVERSE 29B
Davidau · tensorblock
Params29.2B
Context1000K
Smallest11.0 GB
SO
SOLAR 10.7B v1.1
Solar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
LL
Llama 3.2 1B Instruct cold start ft2
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
CO
Cotype Nano
Cotype · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
BI
Bielik SOLAR LIKE 10.7B Instruct v0.1
Bielik · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
FR
Freewheelin Free Solar Slerp v0.3
Free · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
LL
Llama 3 8B Magpie Align v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Dnotitia Llama DNA 1.0 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
CU
Custom KoLLM 13B v1
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
TA
Tau 0.5B
Tau · tensorblock
Params464M
Context32K
Smallest0.2 GB
FA
Falcon 11B
Falcon · tensorblock
Params11.1B
Context2K
Smallest4.3 GB
CO
Rak R05 Coldint Sn29
Coldint · tensorblock
Params6.88B
Context4K
Smallest2.9 GB
LL
Llama 3 Patronus Lynx 8B Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Changgil K2S3 Llama2 13b v1.0
Llama · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
ST
Bigcode Starcoder2 3b
StarCoder · tensorblock
Params3.03B
Context16K
Smallest1.2 GB