GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Meta Llama Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama3 TenyxChat 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
LL
Huggyllama Llama 7b
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
QW
Mlabonne Qwen3 8B Abliterated
Qwen · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
ReasoningTool use
VI
Vicuna 7b v1.3
Vicuna · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
BA
Barcenas Tiny 1.1b DPO
Barcenas · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
DI
Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
GGUF
ST
L3 8B Stheno v3.3 32K
Stheno · tensorblock
Params8.03B
Context32K
Smallest3.2 GB
GGUF
GH
Ghost 8b Beta
Ghost · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Tool use
GR
Ibm Granite Granite 3.0 1b A400M Base
Granite · tensorblock
Params1.38B
Context4K
Smallest0.5 GB
GGUF
QW
Qwen2 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
GGUF
ES
EstopianMaid 13B
Estopianmaid · tensorblock
Params13B
Context4K
Smallest4.9 GB
Roleplay
LL
Llama 3.1 Tulu 3 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Onnx Internal Testing Tiny Random LlamaForCausalLM Untied
Llama · tensorblock
Params8M
Context128K
Smallest0.0 GB
GGUF
ZE
UCLA AGI Zephyr 7b Sft Full SPIN Iter2
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DA
DavidAU MN DARKEST UNIVERSE 29B
Davidau · tensorblock
Params29.2B
Context1000K
Smallest11.0 GB
GGUF
SO
SOLAR 10.7B v1.1
Solar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
LL
Llama 3.2 1B Instruct cold start ft2
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
Tool use
CO
Cotype Nano
Cotype · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
BI
Bielik SOLAR LIKE 10.7B Instruct v0.1
Bielik · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
FR
Freewheelin Free Solar Slerp v0.3
Free · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
LL
Llama 3 8B Magpie Align v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Dnotitia Llama DNA 1.0 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
CU
Custom KoLLM 13B v1
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
TA
Tau 0.5B
Tau · tensorblock
Params464M
Context32K
Smallest0.2 GB
GGUF
FA
Falcon 11B
Falcon · tensorblock
Params11.1B
Context2K
Smallest4.3 GB
GGUF
CO
Rak R05 Coldint Sn29
Coldint · tensorblock
Params6.88B
Context4K
Smallest2.9 GB
GGUF
LL
Llama 3 Patronus Lynx 8B Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Changgil K2S3 Llama2 13b v1.0
Llama · tensorblock
Params13.3B
Context4K
Smallest5.0 GB
GGUF
ST
Bigcode Starcoder2 3b
StarCoder · tensorblock
Params3.03B
Context16K
Smallest1.2 GB
Coding

Keep browsing