GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
AgentPublic Llama3 Instruct 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OP
Weyaxi OpenHermes 2.5 Neural Chat 7b v3 1 7B
Openhermes · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Mistral Ita 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
VI
Vicuzard 30B Uncensored
Vicuzard · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
FL
flux 7b v0.1
Flux · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
calme 2.4 llama3 70b
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
MY
Peterkang Mymodel_V3
Mymodel · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 3 Instruct 8B KTO
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
CO
Danielbrdz CodeBarcenas 1b
Codebarcenas · tensorblock
Params1.24B
Context8K
Smallest0.6 GB
LL
Llama 3 Swallow 8B v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GE
IlyaGusev saiga gemma2 9b
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
KU
Nlpai Lab KULLM3
Kullm · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
NE
Weyaxi Neural Chat 7b v3 1 Nebula v2 7B
Neural · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LO
THU KEG LongWriter Zero 32B
Longwriter · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
DI
Dicta Il Dictalm2.0
Dictalm · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
TI
TinyLlama 1.1B intermediate step 240k 503b
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GE
generative qa model
Generative · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
QW
R2E Edits Qwen3_Claude_37_48K_Tokenized_Sft_Lr_1En5_Epoch_1_Bs_1_Ga_8
Qwen · tensorblock
Params32.8B
Context40K
Smallest12.3 GB
YI
Bhenrym14 Airoboros 3_1 Yi 34b 200k
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
CO
COKAL v1 70B
Cokal · tensorblock
Params69.4B
Context2K
Smallest25.7 GB
SO
SOLAR_C v1 10.7B
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GR
Ibm Granite Granite 3.0 3b A800M Instruct
Granite · tensorblock
Params3.37B
Context4K
Smallest1.3 GB
MI
lewtun mistral 7b sft ultrachat arithmo full
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 3.1 8B Instruct Mental Health Classification
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MI
mistral 7b finance v1.0 mergedmodel
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
Trashpanda Org Qwen2.5 72B Azalea v0
Qwen · tensorblock
Params16M
Context32K
Smallest0.0 GB
LL
Deepnet SN29 C00 Llama HK14 1
Llama · tensorblock
Params6.88B
Context4K
Smallest2.9 GB
ZE
zephyr neural chat frankenmerge11b
Zephyr · tensorblock
Params11.4B
Context32K
Smallest4.2 GB
NO
KBNIT Nox Solar 10.7b v4 Kolon All 5 v2.0
Nox · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
MI
Mistral 7B Instruct KTO
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB