GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
AM
Ambari 7B Instruct v0.1 sharded
Ambari · tensorblock
Params6.88B
Context4K
Smallest2.6 GB
XL
xLAM v0.1 r
Xlam · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
LL
Llama 3.1 70B Instruct lorablated
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
IN
Internlm Internlm2_5 1_8b Chat
InternLM · tensorblock
Params1.89B
Context32K
Smallest0.8 GB
LL
Aisingapore Llama3 8b Cpt Sea Lionv2 Base
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
ZE
zephyr python ru merged
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AI
Mu0Gum AIFT Yi Ko 6B v1.11
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GE
Alpindale Gemma 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
HY
Naver Hyperclovax HyperCLOVAX SEED Text Instruct 0.5B
Hyperclovax · tensorblock
Params566M
Context8K
Smallest0.3 GB
TE
Migtissera Tess 34B v1.4
Tess · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
TR
Voicelab Trurl 2 7b
Trurl · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GE
mp gemma9b sft
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
LU
OpenLLM France Lucie 7B
Lucie · tensorblock
Params6.71B
Context31K
Smallest2.6 GB
TR
Trurl 2 13b
Trurl · tensorblock
Params13B
Context4K
Smallest4.9 GB
TI
Qihoo360 TinyR1 32B Preview
Tinyr · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
BR
MediaTek Research Breeze 7B Instruct V1_0
Breeze · tensorblock
Params7.49B
Context32K
Smallest2.9 GB
SM
PowerInfer SmallThinker 3B Preview
Smallthinker · tensorblock
Params3.4B
Context32K
Smallest1.4 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
BI
BioMistral BioMistral 7B
Biomistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SO
Kodonho SolarM SakuraSolar SLERP
Solarm · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
7B
7B v0.2
tensorblock
Params7.62B
Context32K
Smallest3.0 GB
TU
TucanoBR Tucano 2b4 Instruct
Tucano · tensorblock
Params2.44B
Context4K
Smallest0.9 GB
ME
Sadou Medgemma 4b It French Medical Assistant
Medgemma · tensorblock
Params4.55B
Context128K
Smallest1.9 GB
SA
SauerkrautLM 1.5b
Sauerkrautlm · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
LL
Shibing624 Llama 3 8b Instruct 262k Chinese
Llama · tensorblock
Params8.03B
Context256K
Smallest3.2 GB
BL
Bigscience Bloom 560m
Bloom · tensorblock
Params816M
Context1K
Smallest0.4 GB
DE
Huihui Ai DeepSeek R1 Distill Qwen 7B Abliterated
DeepSeek · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
PL
CYFRAGOVPL PLLuM 12B Chat
Pllum · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
GE
Princeton Nlp Gemma 2 9b It DPO
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
SE
ByteDance Seed Seed Coder 8B Reasoning Bf16
Seed · tensorblock
Params8.25B
Context64K
Smallest3.3 GB