GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
ME
MetaMath OpenHermes 2.5 neural chat v3 3 Slerp
Metamath · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GE
Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
LL
CompassioninMachineLearning 10kalpaca_plus_llama31_8bInstruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
XL
neural coder xlam finetuned 1
Xlam · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
QW
qwen3_1.7B_sft_correct_v3_1e-5_4
Qwen · tensorblock
Params2.03B
Context40K
Smallest0.9 GB
DE
asm2asm deepseek1.3b xtokenizer armv8
DeepSeek · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
LL
Migtissera Tess 2.0 Llama 3 70B v0.2
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
PY
Ajibawa 2023 Python Code 13B
Python · tensorblock
Params13B
Context4K
Smallest4.9 GB
MC
L MChat Small
Mchat · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
SY
Maywell Synatra 11B Tb2M_SM
Synatra · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
HA
Hathor Tahsin L3 8B v0.85
Hathor · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OR
Orbina Orbita v0.1
Orbita · tensorblock
Params14.2B
Context32K
Smallest5.9 GB
FO
2p8xx Foundation Sec 8B Instruct
Foundation · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MI
bitext Mistral 7B Banking v2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
mistral7b lora multiturn v4
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
KO
C1Park Kosolra Kullm LDCC Merge
Kosolra · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
LL
Undi95 Llama 3 LewdPlay 8B Evo
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Mistral Nemo 12B R1 v0.1
Mistral · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
LL
SumayyaAli tiny llama 1.1b chat medical
Llama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
MI
Mistral7B PairRM SPPO Iter1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
Ethicalabs Kurtis E1.1 Qwen2.5 3B Instruct
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
RE
Smallcloudai Refact 1_6 Base
Refact · tensorblock
Params1.59B
Context4K
Smallest0.6 GB
TI
Locutusque TinyMistral 248M
Tinymistral · tensorblock
Params248M
Context32K
Smallest0.1 GB
GP
Gpt2 Medium
Gpt · tensorblock
Params406M
Context1K
Smallest0.2 GB
LL
RedHatAI Llama 2 7b gsm8k
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
Speechlessai Speechless Codellama Dolphin Orca Platypus 13b
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
ME
Ibm Merlinite 7b
Merlinite · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
BI
BioMistral MedMNX
Biomistral · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
PE
Allura Org Q3 30b A3b Pentiment
Pentiment · tensorblock
Params30.5B
Context32K
Smallest11.3 GB
ZE
zefiro 7b sft qlora ITA v0.5
Zefiro · tensorblock
Params7.24B
Context32K
Smallest2.7 GB