GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
GE
Google Gemma 3 4b It
Gemma · tensorblock
Params3.88B
Context128K
Smallest1.7 GB
Vision
GE
Google Gemma 3 12b It
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
Vision
ST
L3 8B Stheno v3.2
Stheno · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
TI
Raincandy U TinyStories 656K
Tinystories · tensorblock
Params—
Context512
Smallest0.0 GB
GGUF
CO
CyberNative AI Colibri_8b_v0.1
Colibri · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
PH
Dolphin 2.9.2 Phi 3 Medium
Phi · tensorblock
Params14B
Context4K
Smallest5.2 GB
CodingTool use
SE
sexyGPT Uncensored
Sexygpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
LL
Llama 3 Patronus Lynx 8B Instruct v1.1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
QW
Qwen Qwen2 VL 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Vision
DE
KnutJaegersberg Deacon 34B
Deacon · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
LL
Llama 2 70b Chat Hf
Llama · tensorblock
Params1.38B
Context4K
Smallest0.6 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Roleplay
FE
Ferret_7B
Ferret · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
TI
ModelCloud Tinyllama 15M Stories
Tinyllama · tensorblock
Params15M
Context256
Smallest0.0 GB
GGUF
TI
TinyLlama TinyLlama 1.1B Intermediate Step 955k Token 2T
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
QW
Huihui Ai Huihui Qwen3 4B Abliterated v2
Qwen · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · tensorblock
Params3.61B
Context128K
Smallest1.5 GB
Tool use
LL
Huihui Ai Llama 3.2 1B Instruct Abliterated
Llama · tensorblock
Params1.5B
Context128K
Smallest0.7 GB
Tool use
LL
Llama 3 Ko 8B Instruct AOG
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
QW
Qwen Qwen2.5 1.5B Instruct
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
YU
YuE s1 7B anneal en icl
Yue · tensorblock
Params6.22B
Context16K
Smallest2.4 GB
GGUF
TU
TurdusBeagle 7B
Turdusbeagle · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama 3 Groq 8B Tool Use
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Tool use
SM
SmolLM2 360M Instruct
SmolLM · tensorblock
Params362M
Context8K
Smallest0.2 GB
GGUF
QW
Qwen Qwen2.5 Coder 1.5B Instruct
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
CodingTool use
SM
SmolLM2 360M Instruct
SmolLM · tensorblock
Params362M
Context8K
Smallest0.2 GB
GGUF
JA
janus orpo 7b
Janus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
ariG23498 Tiny Llama3 Test
Llama · tensorblock
Params16M
Context8K
Smallest0.0 GB
GGUF
PR
prometheus 7b v2.0
Prometheus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF

Keep browsing