GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
QW
Dnotitia Smoothie Qwen3 1.7B
Qwen · tensorblock
Params1.72B
Context40K
Smallest0.8 GB
YI
01 Ai Yi 9B 200K
Yi · tensorblock
Params8.83B
Context256K
Smallest3.4 GB
ST
STILL 3 1.5B Preview
Still · tensorblock
Params1.78B
Context128K
Smallest0.8 GB
MI
NeuralHermes 2.5 Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SO
SOLAR 10.7B v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
llama3 eng ko 8b sl
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OP
OpenCodeInterpreter DS 1.3B
Opencodeinterpreter · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
CO
ConfigurableSOLAR 10.7B
Configurablesolar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
AR
Pythia 2.8b
Archangel · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
LL
Dobby Mini Leashed Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GP
gpt2 dolly
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
MI
Mistral Nemo Japanese Instruct 2408
Mistral · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
LL
Llama 3.1 Korean 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GE
Gemma 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
BA
LTC AI Labs L2 7b Base WVG Uncensored
Base · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MI
Mistral7B PairRM SPPO
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Caisarl76 Mistral 7B OpenOrca Guanaco Accu16
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NU
Nusantara 0.8b Indo Chat
Nusantara · tensorblock
Params825M
Context32K
Smallest0.4 GB
MI
BAAI Infinity Instruct 7M Gen Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SU
SuperNova Medius
Supernova · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
CO
ConfigurableBeagle 11B
Configurablebeagle · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
FI
fietje 2 instruct
Fietje · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
CO
code gpt2 mini model
Code · tensorblock
Params163M
Context1K
Smallest0.1 GB
VO
Volare
Volare · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
SU
DISLab SummLlama3.2 3B
Summllama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
HE
OEvortex HelpingAI Lite
Helpingai · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
PE
Pearl 7B slerp
Pearl · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Medichat Llama3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
EX
LGAI EXAONE EXAONE 3.5 32B Instruct
Exaone · tensorblock
Params32B
Context32K
Smallest11.9 GB