GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Danieldk Qwen2.5 1.5B Instruct W8A8 Int Dynamic Weight
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
TU
Allenai Tulu 2 Dpo 13b
Tulu · tensorblock
Params13B
Context8K
Smallest4.9 GB
GGUF
LL
Llama-3-8B-Instruct-v0.10
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
QW
Qwen Qwen1.5 7B Chat
Qwen · tensorblock
Params7.72B
Context32K
Smallest3.1 GB
GGUF
GP
Akrishnan Gpt2 20M Unlearning BIOSR_supersampled_biographies_x100_lr_0.0005_seed_123
Gpt · tensorblock
Params32M
Context512
Smallest0.0 GB
GGUF
LL
Jennny llama3 8b sft helpsteer
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
dolphin 2.9 llama3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
CodingTool use
QW
Qwen2.5 Math 1.5B
Qwen · tensorblock
Params1.54B
Context4K
Smallest0.7 GB
GGUF
SP
Uukuguy Speechless Coding 7b 16k Tora
Speechless · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
AD
W601Sxs B1Ade 1b Bf16
Ade · tensorblock
Params1.01B
Context2K
Smallest0.4 GB
GGUF
SA
Moraliane SAINEMO reMIX
Sainemo · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
Roleplay
QW
Mlx Community Josiefied Qwen2.5 0.5B Instruct Abliterated v1 Float32
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
Tool use
OL
OlympicCoder 7B
Olympiccoder · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
CodingReasoningTool use
LU
L3 8B Lunaris v1
Lunaris · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
DE
Openbuddy Deepseek 67b v15.2
DeepSeek · tensorblock
Params67.4B
Context4K
Smallest25.1 GB
GGUF
QW
Qwen2.5 3B
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Reasoning
NE
NeuDist Ro 7B
Neudist · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
OP
Infly OpenCoder 1.5B Instruct
Opencoder · tensorblock
Params1.91B
Context4K
Smallest1.1 GB
Coding
GR
Ibm Granite Granite 20b Code Base 8k
Granite · tensorblock
Params20.1B
Context8K
Smallest7.9 GB
Coding
UN
UndiMix v4 13B
Undimix · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Llama 3 Refueled
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
NO
Nous Hermes 2 MoE 2x34B
Nous · tensorblock
Params60.8B
Context4K
Smallest22.4 GB
Tool use
IN
Internlm Internlm2_5 20b
InternLM · tensorblock
Params19.9B
Context256K
Smallest7.5 GB
GGUF
MI
Openbuddy Mixtral 7bx8 v16.3 32k
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
LL
dolphin 2.9.1 llama 3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
CodingTool use
WI
Heegyu WizardVicuna Uncensored 3B 0719
Wizardvicuna · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
GGUF
LL
Tarun7R Finance Llama 8B
Llama · tensorblock
Params21M
Context128K
Smallest0.0 GB
GGUF
RE
Reasoning 0.5b
Reasoning · tensorblock
Params494M
Context32K
Smallest0.3 GB
Reasoning
QW
Winglian Qwen3 14b Triton v1
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
ReasoningTool use
BI
BioMistral Zephyr Beta SLERP
Biomistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF

Keep browsing