GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AM
Ambari 7B Instruct v0.1 sharded
Ambari · tensorblock
Params6.88B
Context4K
Smallest2.6 GB
GGUF
XL
xLAM v0.1 r
Xlam · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
Tool use
LL
Llama 3.1 70B Instruct lorablated
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
IN
Internlm Internlm2_5 1_8b Chat
InternLM · tensorblock
Params1.89B
Context32K
Smallest0.8 GB
GGUF
LL
Aisingapore Llama3 8b Cpt Sea Lionv2 Base
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
ZE
zephyr python ru merged
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AI
Mu0Gum AIFT Yi Ko 6B v1.11
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
GE
Alpindale Gemma 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
HY
Naver Hyperclovax HyperCLOVAX SEED Text Instruct 0.5B
Hyperclovax · tensorblock
Params566M
Context8K
Smallest0.3 GB
GGUF
TE
Migtissera Tess 34B v1.4
Tess · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
TR
Voicelab Trurl 2 7b
Trurl · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
GE
mp gemma9b sft
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
LU
OpenLLM France Lucie 7B
Lucie · tensorblock
Params6.71B
Context31K
Smallest2.6 GB
GGUF
TR
Trurl 2 13b
Trurl · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
TI
Qihoo360 TinyR1 32B Preview
Tinyr · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
BR
MediaTek Research Breeze 7B Instruct V1_0
Breeze · tensorblock
Params7.49B
Context32K
Smallest2.9 GB
GGUF
SM
PowerInfer SmallThinker 3B Preview
Smallthinker · tensorblock
Params3.4B
Context32K
Smallest1.4 GB
Reasoning
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ReasoningTool use
BI
BioMistral BioMistral 7B
Biomistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SO
Kodonho SolarM SakuraSolar SLERP
Solarm · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
7B
7B v0.2
tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
TU
TucanoBR Tucano 2b4 Instruct
Tucano · tensorblock
Params2.44B
Context4K
Smallest0.9 GB
GGUF
ME
Sadou Medgemma 4b It French Medical Assistant
Medgemma · tensorblock
Params4.55B
Context128K
Smallest1.9 GB
GGUF
SA
SauerkrautLM 1.5b
Sauerkrautlm · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
GGUF
LL
Shibing624 Llama 3 8b Instruct 262k Chinese
Llama · tensorblock
Params8.03B
Context256K
Smallest3.2 GB
GGUF
BL
Bigscience Bloom 560m
Bloom · tensorblock
Params816M
Context1K
Smallest0.4 GB
Coding
DE
Huihui Ai DeepSeek R1 Distill Qwen 7B Abliterated
DeepSeek · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
ReasoningTool use
PL
CYFRAGOVPL PLLuM 12B Chat
Pllum · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
GGUF
GE
Princeton Nlp Gemma 2 9b It DPO
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
SE
ByteDance Seed Seed Coder 8B Reasoning Bf16
Seed · tensorblock
Params8.25B
Context64K
Smallest3.3 GB
CodingReasoning

Keep browsing