GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
llama 7b SFT eli5 wiki65k 1024 r 64 alpha 16 merged
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
VI
Violet Twilight v0.2
Violet · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
QW
ArliAI DS R1 Qwen3 8B ArliAI RpR v4 Small
Qwen · tensorblock
Params8.19B
Context128K
Smallest3.3 GB
MI
mindy 7b v2
Mindy · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CH
Chat_Gpt2
Chat · tensorblock
Params163M
Context1K
Smallest0.1 GB
MI
Mistral Passthrough 8L 10B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AD
Umm Maybe Advice Gpt2Bot
Advice · tensorblock
Params121M
Context1K
Smallest0.1 GB
QW
Felladrin Qwen2 96M
Qwen · tensorblock
Params96M
Context8K
Smallest0.1 GB
LL
Shenzhi Wang Llama3 8B Chinese Chat
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
PY
EleutherAI Pythia 410m
Pythia · tensorblock
Params405M
Context2K
Smallest0.2 GB
QW
Mlx Community Qwen3 1.7B Bf16
Qwen · tensorblock
Params1.72B
Context40K
Smallest0.8 GB
ZE
HuggingFaceH4 Zephyr 7b Alpha
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Ko Mixtral v1.3
Mistral · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
KO
SOLAR 10.7B
Kosolar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
BL
Bloomz 3b Sft Chat
Bloomz · tensorblock
Params3.64B
Context3K
Smallest1.6 GB
SA
CarbonVillain En 10.7B v2
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
SF
SFT merged fp16 DFINAL 1.1K steps
Sft · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
WI
yeontaek WizardCoder Python 13B LoRa
Wizardcoder · tensorblock
Params13B
Context16K
Smallest4.9 GB
MI
EM German
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GR
Ibm Granite Granite 7b Instruct
Granite · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
llama 3 instruct slerp arabic
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
BI
BioLlama Ko 8B
Biollama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Allenai Llama 3 Tulu 2 Dpo 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OL
Allenai OLMo 1B 0724 Hf
OLMo · tensorblock
Params1.28B
Context4K
Smallest0.5 GB
QW
krx qwen2 7b instruct v4 m
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
EN
Yi Ko 6B
Enin · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
HA
Hathor_Stable v0.2 L3 8B
Hathor · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Tamil Llama 7b Instruct v0.1
Llama · tensorblock
Params6.87B
Context4K
Smallest2.6 GB
QW
calme-2.5-qwen2-7b
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
PY
Pythia 1.4b Deduped
Pythia · tensorblock
Params1.41B
Context2K
Smallest0.6 GB