GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
Danieldk Qwen2.5 1.5B Instruct W8A8 Int Dynamic Weight
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
TU
Allenai Tulu 2 Dpo 13b
Tulu · tensorblock
Params13B
Context8K
Smallest4.9 GB
LL
Llama-3-8B-Instruct-v0.10
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
QW
Qwen Qwen1.5 7B Chat
Qwen · tensorblock
Params7.72B
Context32K
Smallest3.1 GB
GP
Akrishnan Gpt2 20M Unlearning BIOSR_supersampled_biographies_x100_lr_0.0005_seed_123
Gpt · tensorblock
Params32M
Context512
Smallest0.0 GB
LL
Jennny llama3 8b sft helpsteer
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
dolphin 2.9 llama3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
QW
Qwen2.5 Math 1.5B
Qwen · tensorblock
Params1.54B
Context4K
Smallest0.7 GB
SP
Uukuguy Speechless Coding 7b 16k Tora
Speechless · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
AD
W601Sxs B1Ade 1b Bf16
Ade · tensorblock
Params1.01B
Context2K
Smallest0.4 GB
SA
Moraliane SAINEMO reMIX
Sainemo · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
QW
Mlx Community Josiefied Qwen2.5 0.5B Instruct Abliterated v1 Float32
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
OL
OlympicCoder 7B
Olympiccoder · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
LU
L3 8B Lunaris v1
Lunaris · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
DE
Openbuddy Deepseek 67b v15.2
DeepSeek · tensorblock
Params67.4B
Context4K
Smallest25.1 GB
QW
Qwen2.5 3B
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
NE
NeuDist Ro 7B
Neudist · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
OP
Infly OpenCoder 1.5B Instruct
Opencoder · tensorblock
Params1.91B
Context4K
Smallest1.1 GB
GR
Ibm Granite Granite 20b Code Base 8k
Granite · tensorblock
Params20.1B
Context8K
Smallest7.9 GB
UN
UndiMix v4 13B
Undimix · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Llama 3 Refueled
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
NO
Nous Hermes 2 MoE 2x34B
Nous · tensorblock
Params60.8B
Context4K
Smallest22.4 GB
IN
Internlm Internlm2_5 20b
InternLM · tensorblock
Params19.9B
Context256K
Smallest7.5 GB
MI
Openbuddy Mixtral 7bx8 v16.3 32k
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
LL
dolphin 2.9.1 llama 3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
WI
Heegyu WizardVicuna Uncensored 3B 0719
Wizardvicuna · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
LL
Tarun7R Finance Llama 8B
Llama · tensorblock
Params21M
Context128K
Smallest0.0 GB
RE
Reasoning 0.5b
Reasoning · tensorblock
Params494M
Context32K
Smallest0.3 GB
QW
Winglian Qwen3 14b Triton v1
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
BI
BioMistral Zephyr Beta SLERP
Biomistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB