GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
GE
Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GE
Google Gemma 3 4b It
Gemma · tensorblock
Params3.88B
Context128K
Smallest1.7 GB
GE
Google Gemma 3 12b It
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
ST
L3 8B Stheno v3.2
Stheno · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
TI
Raincandy U TinyStories 656K
Tinystories · tensorblock
Params—
Context512
Smallest0.0 GB
CO
CyberNative AI Colibri_8b_v0.1
Colibri · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
PH
Dolphin 2.9.2 Phi 3 Medium
Phi · tensorblock
Params14B
Context4K
Smallest5.2 GB
SE
sexyGPT Uncensored
Sexygpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
LL
Llama 3 Patronus Lynx 8B Instruct v1.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
QW
Qwen Qwen2 VL 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
DE
KnutJaegersberg Deacon 34B
Deacon · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
LL
Llama 2 70b Chat Hf
Llama · tensorblock
Params1.38B
Context4K
Smallest0.6 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
FE
Ferret_7B
Ferret · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
TI
ModelCloud Tinyllama 15M Stories
Tinyllama · tensorblock
Params15M
Context256
Smallest0.0 GB
TI
TinyLlama TinyLlama 1.1B Intermediate Step 955k Token 2T
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
QW
Huihui Ai Huihui Qwen3 4B Abliterated v2
Qwen · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
LL
Llama 3.2 3B Instruct
Llama · tensorblock
Params3.61B
Context128K
Smallest1.5 GB
LL
Huihui Ai Llama 3.2 1B Instruct Abliterated
Llama · tensorblock
Params1.5B
Context128K
Smallest0.7 GB
LL
Llama 3 Ko 8B Instruct AOG
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
QW
Qwen Qwen2.5 1.5B Instruct
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
YU
YuE s1 7B anneal en icl
Yue · tensorblock
Params6.22B
Context16K
Smallest2.4 GB
TU
TurdusBeagle 7B
Turdusbeagle · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 3 Groq 8B Tool Use
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SM
SmolLM2 360M Instruct
SmolLM · tensorblock
Params362M
Context8K
Smallest0.2 GB
QW
Qwen Qwen2.5 Coder 1.5B Instruct
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
SM
SmolLM2 360M Instruct
SmolLM · tensorblock
Params362M
Context8K
Smallest0.2 GB
JA
janus orpo 7b
Janus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
ariG23498 Tiny Llama3 Test
Llama · tensorblock
Params16M
Context8K
Smallest0.0 GB
PR
prometheus 7b v2.0
Prometheus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB