GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama 7b SFT eli5 wiki65k 1024 r 64 alpha 16 merged
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
VI
Violet Twilight v0.2
Violet · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
Roleplay
QW
ArliAI DS R1 Qwen3 8B ArliAI RpR v4 Small
Qwen · tensorblock
Params8.19B
Context128K
Smallest3.3 GB
ReasoningTool use
MI
mindy 7b v2
Mindy · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
CH
Chat_Gpt2
Chat · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
MI
Mistral Passthrough 8L 10B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AD
Umm Maybe Advice Gpt2Bot
Advice · tensorblock
Params121M
Context1K
Smallest0.1 GB
GGUF
QW
Felladrin Qwen2 96M
Qwen · tensorblock
Params96M
Context8K
Smallest0.1 GB
GGUF
LL
Shenzhi Wang Llama3 8B Chinese Chat
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
PY
EleutherAI Pythia 410m
Pythia · tensorblock
Params405M
Context2K
Smallest0.2 GB
GGUF
QW
Mlx Community Qwen3 1.7B Bf16
Qwen · tensorblock
Params1.72B
Context40K
Smallest0.8 GB
ReasoningTool use
ZE
HuggingFaceH4 Zephyr 7b Alpha
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Ko Mixtral v1.3
Mistral · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
GGUF
KO
SOLAR 10.7B
Kosolar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
BL
Bloomz 3b Sft Chat
Bloomz · tensorblock
Params3.64B
Context3K
Smallest1.6 GB
GGUF
SA
CarbonVillain En 10.7B v2
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
Coding
SF
SFT merged fp16 DFINAL 1.1K steps
Sft · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
WI
yeontaek WizardCoder Python 13B LoRa
Wizardcoder · tensorblock
Params13B
Context16K
Smallest4.9 GB
Coding
MI
EM German
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
GR
Ibm Granite Granite 7b Instruct
Granite · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
llama 3 instruct slerp arabic
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
BI
BioLlama Ko 8B
Biollama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Allenai Llama 3 Tulu 2 Dpo 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OL
Allenai OLMo 1B 0724 Hf
OLMo · tensorblock
Params1.28B
Context4K
Smallest0.5 GB
GGUF
QW
krx qwen2 7b instruct v4 m
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
GGUF
EN
Yi Ko 6B
Enin · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
HA
Hathor_Stable v0.2 L3 8B
Hathor · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Tamil Llama 7b Instruct v0.1
Llama · tensorblock
Params6.87B
Context4K
Smallest2.6 GB
GGUF
QW
calme-2.5-qwen2-7b
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
PY
Pythia 1.4b Deduped
Pythia · tensorblock
Params1.41B
Context2K
Smallest0.6 GB
GGUF

Keep browsing