GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Ko Llama3 Luxia 8B
Llama · tensorblock
Params8.17B
Context8K
Smallest3.3 GB
ME
Med GPT2
Med · tensorblock
Params163M
Context1K
Smallest0.1 GB
DE
Mlxha DeepSeek R1 Distill Llama 8B Notemplate
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
DE
Deepseek Ai DeepSeek R1 0528 Qwen3 8B
DeepSeek · tensorblock
Params8.19B
Context128K
Smallest3.3 GB
OC
Occiglot Occiglot 7b Es En Instruct
Occiglot · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Krevas LDCC Instruct Llama 2 Ko 13B v4.2.4
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
AY
CohereForAI Aya 23 8B
Aya · tensorblock
Params8.03B
Context8K
Smallest3.4 GB
LL
Freewheelin Free Llama3 Dpo v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
VU
Vuiseng9 Ov Gpt2 Fp32 No Cache
Vuiseng · tensorblock
Params163M
Context1K
Smallest0.1 GB
OP
Optimus 7B
Optimus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 2 7b
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
CO
Code_Gpt2
Code · tensorblock
Params163M
Context1K
Smallest0.1 GB
LL
Llama 3.1 8B EZO 1.1 it
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 2 7B Chat fp16
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
CA
calme-3.3-instruct-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
QW
Goekdeniz Guelmez Josiefied Qwen3 30B A3B Abliterated v2
Qwen · tensorblock
Params30.5B
Context40K
Smallest11.3 GB
KA
Kakaocorp Kanana Safeguard 8b
Kanana · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
PY
Felladrin Pythia 31M Chat v1
Pythia · tensorblock
Params31M
Context2K
Smallest0.0 GB
MI
Decem Dionysus Mistral M3 v6
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Hjgugugjhuhjggg Llama 3.2 1B Spinquant Hf
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
MA
MN 12B Mag Mell R1
Mag · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GP
Rhysjones Gpt2 124M Edu Fineweb 10B
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
SM
SmolLM 135M
SmolLM · tensorblock
Params135M
Context8K
Smallest0.1 GB
LL
Llama 2 KoEn 13B
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
LL
Llama 3.2 1B
Llama · tensorblock
Params417M
Context128K
Smallest0.2 GB
MI
Mistral CatMacaroni Slerp Uncensored
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DO
DopeyTinyLlama 1.1B v1
Dopeytinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
TI
TinyLlama TinyLlama 1.1B Intermediate Step 480k 1T
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
MA
Openaccess Ai Collective Manticore 13b Chat Pyg
Manticore · tensorblock
Params13B
Context2K
Smallest4.9 GB
LL
Llama 3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB