GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Codellama 13b Oasst Sft v10
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
LL
Llama 3.1 MedIT SUN 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GE
gemma 2 2b neogenesis ita
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
JA
Unsloth Jan Nano
Jan · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
DC
oh dcft v1.2 no curation gpt 4o mini
Dcft · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
LlaMaestra 3.2 1B Translation
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
JA
Stabilityai Japanese Stablelm Base Beta 70b
Japanese · tensorblock
Params69B
Context4K
Smallest25.5 GB
AM
Ambari 7B base v0.1 sharded
Ambari · tensorblock
Params6.88B
Context4K
Smallest2.6 GB
LL
llama-3.2-3b-sft
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
AR
PhysicsWallahAI Aryabhata 1.0
Aryabhata · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
LL
RedHatAI Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
AI
Aira 2 1B1
Aira · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
QW
Willcb Qwen3 8B
Qwen · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
AF
Alphatao Affine 9711767
Affine · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
LL
TheBloke CodeLlama 7B Fp16
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
PH
Kenhktsui Nano Phi 115M v0.1
Phi · tensorblock
Params115M
Context1K
Smallest0.1 GB
OC
Occitan Distilgpt2 Medium
Occitan · tensorblock
Params121M
Context1K
Smallest0.1 GB
LL
Llama 3 8B Magpie Align v0.3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
MiniLLM MiniLLM Gpt2 120M
Minillm · tensorblock
Params163M
Context1K
Smallest0.1 GB
SP
Uukuguy Speechless Orca Platypus Coig Lite 4k 0.5e 13b
Speechless · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Llama 3 70B Orpo v0.1
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
PR
prometheus bgb 8x7b v2.0
Prometheus · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
ST
starchat2 15b v0.1
Starchat · tensorblock
Params16B
Context16K
Smallest6.2 GB
MI
EmbeddedLLM Mistral 7B Merge 14 v0.3
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
UX
CortexCereal Uxux
Uxux · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
OR
Orca Platypus v3 1epoch
Orca · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
LL
llama3.2 3b merged bslm product catalogs
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
LL
Reflection Llama 3.1 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
CO
COKA DPO test v1
Coka · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
LL
Llama3 ko 4.2 sft
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB