GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5-1.5B-Open-R1-Distill
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
ReasoningTool use
LL
Meta Llama Llama 3.2 3B Instruct
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
LL
DarkIdol Llama 3.1 8B Instruct 1.1 Uncensored
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Roleplay
MI
Azure99 Blossom v4 Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
NE
Daredevil 7B
Neuraldaredevil · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
GE
Gemma 2b It
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
AI
AIGym TinyGPT2 81M
Aigym · tensorblock
Params120M
Context128
Smallest0.1 GB
GGUF
JA
janus 7b
Janus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SA
saiga 7b
Saiga · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
GR
Ibm Granite Granite 3.1 8b Instruct
Granite · tensorblock
Params8.17B
Context128K
Smallest3.1 GB
Tool use
EE
Ai Human Lab EEVE Korean 10.8B RAFT
Eeve · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
MI
PIXMELT Mistral 7B Instruct v0.2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
MiniLLM MiniPLM Qwen 200M
Qwen · tensorblock
Params203M
Context32K
Smallest0.1 GB
GGUF
LL
Sheared LLaMA 1.3B
Llama · tensorblock
Params1.35B
Context4K
Smallest0.6 GB
GGUF
GE
gemma ko 7b instruct v0.71
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF
QW
Qwen Qwen1.5 1.8B
Qwen · tensorblock
Params1.84B
Context32K
Smallest0.8 GB
GGUF
SM
Reasoning SmolLM2 135M
SmolLM · tensorblock
Params135M
Context8K
Smallest0.1 GB
Reasoning
DE
Huihui Ai DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ReasoningTool use
ME
Medtulu 4x7B
Medtulu · tensorblock
Params19.7B
Context8K
Smallest7.2 GB
GGUF
DE
Huihui Ai DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
CA
CatPPT base
Catppt · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DA
Daredevil 7B
Daredevil · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Embedding
GE
UCLA AGI Gemma 2 9B It SPPO Iter3
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
SA
Sail Sailor 1.8B Chat
Sailor · tensorblock
Params1.84B
Context32K
Smallest0.8 GB
GGUF
QW
Qwen Qwen2.5 Coder 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
CodingTool use
NO
notus 7b v1
Notus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
OP
openchat 3.5
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
Coding
QW
Qwen2.5 Math 14B Instruct Preview
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
Tool use
MI
ANIMA Cognitive Mistral v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SN
SnowLotus v2 10.7B
Snowlotus · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
Roleplay

Keep browsing