GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
ME
MetaMath OpenHermes 2.5 neural chat v3 3 Slerp
Metamath · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
GE
Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
LL
CompassioninMachineLearning 10kalpaca_plus_llama31_8bInstruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
XL
neural coder xlam finetuned 1
Xlam · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
CodingTool use
QW
qwen3_1.7B_sft_correct_v3_1e-5_4
Qwen · tensorblock
Params2.03B
Context40K
Smallest0.9 GB
GGUF
DE
asm2asm deepseek1.3b xtokenizer armv8
DeepSeek · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
GGUF
LL
Migtissera Tess 2.0 Llama 3 70B v0.2
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
PY
Ajibawa 2023 Python Code 13B
Python · tensorblock
Params13B
Context4K
Smallest4.9 GB
Coding
MC
L MChat Small
Mchat · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
SY
Maywell Synatra 11B Tb2M_SM
Synatra · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
HA
Hathor Tahsin L3 8B v0.85
Hathor · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OR
Orbina Orbita v0.1
Orbita · tensorblock
Params14.2B
Context32K
Smallest5.9 GB
GGUF
FO
2p8xx Foundation Sec 8B Instruct
Foundation · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
MI
bitext Mistral 7B Banking v2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
mistral7b lora multiturn v4
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
KO
C1Park Kosolra Kullm LDCC Merge
Kosolra · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
LL
Undi95 Llama 3 LewdPlay 8B Evo
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
Mistral Nemo 12B R1 v0.1
Mistral · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
ReasoningTool use
LL
SumayyaAli tiny llama 1.1b chat medical
Llama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
MI
Mistral7B PairRM SPPO Iter1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
Ethicalabs Kurtis E1.1 Qwen2.5 3B Instruct
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
RE
Smallcloudai Refact 1_6 Base
Refact · tensorblock
Params1.59B
Context4K
Smallest0.6 GB
Coding
TI
Locutusque TinyMistral 248M
Tinymistral · tensorblock
Params248M
Context32K
Smallest0.1 GB
GGUF
GP
Gpt2 Medium
Gpt · tensorblock
Params406M
Context1K
Smallest0.2 GB
GGUF
LL
RedHatAI Llama 2 7b gsm8k
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Speechlessai Speechless Codellama Dolphin Orca Platypus 13b
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
Coding
ME
Ibm Merlinite 7b
Merlinite · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
BI
BioMistral MedMNX
Biomistral · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
PE
Allura Org Q3 30b A3b Pentiment
Pentiment · tensorblock
Params30.5B
Context32K
Smallest11.3 GB
ReasoningRoleplayTool use
ZE
zefiro 7b sft qlora ITA v0.5
Zefiro · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF

Keep browsing