GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Llama 2 7b Pruned50 Retrained
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
QW
Qwen2.5 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · tensorblock
Params1.86B
Context2K
Smallest0.7 GB
TI
Josephgflowers Tinyllama 616M Cinder
Tinyllama · tensorblock
Params616M
Context2K
Smallest0.3 GB
NE
QI neural chat 7B ko DPO
Neural · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
EC
ECE Poirot
Ece · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
VI
Multi Domain Expert Learning Vietnamese Pythia 3b Deduped 16 31
Vietnamese · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
NE
OpenReasoning Nemotron 14B
Nemotron · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
OP
Weyaxi OpenHermes 2.5 Nebula v2 7B
Openhermes · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
HPAI BSC Qwen2.5 Aloe Beta 7B
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
LL
Llama 3.1 8B Lexi Uncensored
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
QW
Qwen Qwen2 Math 1.5B Instruct
Qwen · tensorblock
Params1.54B
Context4K
Smallest0.7 GB
CO
Codegemma 2b
Codegemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
QW
Qwen Qwen2.5 Coder 32B
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
NE
BarryFutureman NeuralTurdusVariant1 7B
Neuralturdusvariant · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Mistral Small 24B Instruct 2501
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
DU
dulia 13b 8k alpha
Dulia · tensorblock
Params13B
Context8K
Smallest4.9 GB
PH
Luminis phi 4
Phi · tensorblock
Params14.7B
Context16K
Smallest5.6 GB
LL
r1 1776 distill llama 70b
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
EV
Everyone Coder 4x7b Base
Everyone · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
VI
Vicuna Mmlu Val Mcq 7b Ep2
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
RE
SenseLLM ReflectionCoder DS 33B
Reflectioncoder · tensorblock
Params33.3B
Context16K
Smallest12.4 GB
LL
HTML Pruner Llama 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
QW
Qwen2.5 Bakeneko 32b Instruct
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
GE
Google Gemma 2 9b
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
SA
Dr Samantha 7b
Samantha · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
LL
tiny random llama
Llama · tensorblock
Params73M
Context128K
Smallest0.1 GB
LL
beingWell
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
KI
AI MO Kimina Prover Distill 8B
Kimi · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
KA
Karakuri Lm 7b Apm v0.1
Karakuri · tensorblock
Params8.54B
Context8K
Smallest3.5 GB