GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
QW
Dnotitia Smoothie Qwen3 1.7B
Qwen · tensorblock
Params1.72B
Context40K
Smallest0.8 GB
ReasoningTool use
YI
01 Ai Yi 9B 200K
Yi · tensorblock
Params8.83B
Context256K
Smallest3.4 GB
GGUF
ST
STILL 3 1.5B Preview
Still · tensorblock
Params1.78B
Context128K
Smallest0.8 GB
Tool use
MI
NeuralHermes 2.5 Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
SO
SOLAR 10.7B v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
llama3 eng ko 8b sl
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OP
OpenCodeInterpreter DS 1.3B
Opencodeinterpreter · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
Coding
CO
ConfigurableSOLAR 10.7B
Configurablesolar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
AR
Pythia 2.8b
Archangel · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
LL
Dobby Mini Leashed Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
RoleplayTool use
GP
gpt2 dolly
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
MI
Mistral Nemo Japanese Instruct 2408
Mistral · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
LL
Llama 3.1 Korean 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
GE
Gemma 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
Coding
BA
LTC AI Labs L2 7b Base WVG Uncensored
Base · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MI
Mistral7B PairRM SPPO
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Caisarl76 Mistral 7B OpenOrca Guanaco Accu16
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
NU
Nusantara 0.8b Indo Chat
Nusantara · tensorblock
Params825M
Context32K
Smallest0.4 GB
GGUF
MI
BAAI Infinity Instruct 7M Gen Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SU
SuperNova Medius
Supernova · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
Tool use
CO
ConfigurableBeagle 11B
Configurablebeagle · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
FI
fietje 2 instruct
Fietje · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
CO
code gpt2 mini model
Code · tensorblock
Params163M
Context1K
Smallest0.1 GB
Coding
VO
Volare
Volare · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF
SU
DISLab SummLlama3.2 3B
Summllama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
HE
OEvortex HelpingAI Lite
Helpingai · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
PE
Pearl 7B slerp
Pearl · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Medichat Llama3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Coding
EX
LGAI EXAONE EXAONE 3.5 32B Instruct
Exaone · tensorblock
Params32B
Context32K
Smallest11.9 GB
GGUF

Keep browsing