GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
Qwen2.5-1.5B-Open-R1-Distill
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
LL
Meta Llama Llama 3.2 3B Instruct
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.1 Uncensored
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MI
Azure99 Blossom v4 Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NE
Daredevil 7B
Neuraldaredevil · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GE
Gemma 2b It
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
AI
AIGym TinyGPT2 81M
Aigym · tensorblock
Params120M
Context128
Smallest0.1 GB
JA
janus 7b
Janus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SA
saiga 7b
Saiga · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GR
Ibm Granite Granite 3.1 8b Instruct
Granite · tensorblock
Params8.17B
Context128K
Smallest3.1 GB
EE
Ai Human Lab EEVE Korean 10.8B RAFT
Eeve · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
MI
PIXMELT Mistral 7B Instruct v0.2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
MiniLLM MiniPLM Qwen 200M
Qwen · tensorblock
Params203M
Context32K
Smallest0.1 GB
LL
Sheared LLaMA 1.3B
Llama · tensorblock
Params1.35B
Context4K
Smallest0.6 GB
GE
gemma ko 7b instruct v0.71
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
QW
Qwen Qwen1.5 1.8B
Qwen · tensorblock
Params1.84B
Context32K
Smallest0.8 GB
SM
Reasoning SmolLM2 135M
SmolLM · tensorblock
Params135M
Context8K
Smallest0.1 GB
DE
Huihui Ai DeepSeek R1 Distill Llama 8B Abliterated
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ME
Medtulu 4x7B
Medtulu · tensorblock
Params19.7B
Context8K
Smallest7.2 GB
DE
Huihui Ai DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
CA
CatPPT base
Catppt · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DA
Daredevil 7B
Daredevil · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GE
UCLA AGI Gemma 2 9B It SPPO Iter3
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
SA
Sail Sailor 1.8B Chat
Sailor · tensorblock
Params1.84B
Context32K
Smallest0.8 GB
QW
Qwen Qwen2.5 Coder 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
NO
notus 7b v1
Notus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
OP
openchat 3.5
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
QW
Qwen2.5 Math 14B Instruct Preview
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
MI
ANIMA Cognitive Mistral v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SN
SnowLotus v2 10.7B
Snowlotus · tensorblock
Params10.7B
Context4K
Smallest4.0 GB