GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 7b Pruned50 Retrained
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
ReasoningTool use
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · tensorblock
Params1.86B
Context2K
Smallest0.7 GB
GGUF
TI
Josephgflowers Tinyllama 616M Cinder
Tinyllama · tensorblock
Params616M
Context2K
Smallest0.3 GB
GGUF
NE
QI neural chat 7B ko DPO
Neural · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
EC
ECE Poirot
Ece · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
VI
Multi Domain Expert Learning Vietnamese Pythia 3b Deduped 16 31
Vietnamese · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
NE
OpenReasoning Nemotron 14B
Nemotron · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
CodingReasoning
OP
Weyaxi OpenHermes 2.5 Nebula v2 7B
Openhermes · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
QW
HPAI BSC Qwen2.5 Aloe Beta 7B
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
LL
Llama 3.1 8B Lexi Uncensored
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
QW
Qwen Qwen2 Math 1.5B Instruct
Qwen · tensorblock
Params1.54B
Context4K
Smallest0.7 GB
GGUF
CO
Codegemma 2b
Codegemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
QW
Qwen Qwen2.5 Coder 32B
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
CodingTool use
NE
BarryFutureman NeuralTurdusVariant1 7B
Neuralturdusvariant · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
GGUF
DU
dulia 13b 8k alpha
Dulia · tensorblock
Params13B
Context8K
Smallest4.9 GB
GGUF
PH
Luminis phi 4
Phi · tensorblock
Params14.7B
Context16K
Smallest5.6 GB
GGUF
LL
r1 1776 distill llama 70b
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
ReasoningTool use
EV
Everyone Coder 4x7b Base
Everyone · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
Coding
VI
Vicuna Mmlu Val Mcq 7b Ep2
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
RE
SenseLLM ReflectionCoder DS 33B
Reflectioncoder · tensorblock
Params33.3B
Context16K
Smallest12.4 GB
Coding
LL
HTML Pruner Llama 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
Tool use
QW
Qwen2.5 Bakeneko 32b Instruct
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
Tool use
GE
Google Gemma 2 9b
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
SA
Dr Samantha 7b
Samantha · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
LL
tiny random llama
Llama · tensorblock
Params73M
Context128K
Smallest0.1 GB
GGUF
LL
beingWell
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
KI
AI MO Kimina Prover Distill 8B
Kimi · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
ReasoningTool use
KA
Karakuri Lm 7b Apm v0.1
Karakuri · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF

Keep browsing