GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
JA
Jaskier 7b Dpo v6
Jaskier · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
FU
FuseAI FuseChat 7B VaRM
Fusechat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
DE
Delirium v1
Delirium · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
SO
I SOLAR 10.7B Sft v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
ST
Opencsg Opencsg Starcoder2 15b v0.1
StarCoder · tensorblock
Params16B
Context16K
Smallest6.2 GB
Coding
TE
TeenyTinyLlama 160m
Teenytinyllama · tensorblock
Params162M
Context2K
Smallest0.1 GB
GGUF
LL
Mlx Community Llama 3.2 1B Instruct Bf16
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
Tool use
QW
ArliAI Qwen3 30B A3B ArliAI RpR v4 Fast
Qwen · tensorblock
Params30.5B
Context40K
Smallest11.3 GB
ReasoningTool use
AR
Arcee Ai Arcee Blitz
Arcee · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
GGUF
LL
Sronger Ko Llm Llama 2 7b Chat2
Llama · tensorblock
Params622M
Context2K
Smallest0.2 GB
GGUF
TE
k2s3 test 0000
Test · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Chargoddard Yi 34B Llama
Llama · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
CY
cybertron v4 qw7B MGS
Cybertron · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
SE
Severus 7B
Severus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
YI
Yi 34B v2
Yi · tensorblock
Params34.4B
Context8K
Smallest12.8 GB
GGUF
AS
Jin05102518 Astral 7B Instruct v0.01
Astral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
BA
Danielbrdz Barcenas 6b 200k
Barcenas · tensorblock
Params6.06B
Context195K
Smallest2.3 GB
GGUF
LL
llama 3 sqlcoder 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Coding
SO
Kodonho Solar M SakuraSolar Mixed
Solar · tensorblock
Params8.99B
Context4K
Smallest3.4 GB
GGUF
KU
Kunoichi DPO v2 7B
Kunoichi · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
LE
legendary river koalpaca
Legendary · tensorblock
Params1.42B
Context4K
Smallest0.6 GB
GGUF
GE
Gemma 2 27b It
Gemma · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
GGUF
LL
Krevas LDCC Instruct Llama 2 Ko 13B v7.2
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
OP
Open Hermes 2.5 neural chat 3.1 frankenmerge 11b
Open · tensorblock
Params11.4B
Context32K
Smallest4.2 GB
Tool use
LL
llama3.2 typhoon2 3b instruct
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
LL
Iamsahinemir Meta Llama
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
CPO SimPO
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GE
Gemma 2 27b
Gemma · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
GGUF
LL
CHIH HUNG llama 2 13b FINETUNE1 17w r4
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
FU
functionary small v3.1
Functionary · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use

Keep browsing