GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
Qihoo360 Light R1 32B DS
Light · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
WI
TheBloke Wizard Vicuna 30B Uncensored Fp16
Wizard · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
GGUF
LL
llama2 merge v0.2
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
QW
Qwen2.5 Lumen 14B
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
RoleplayTool use
LL
llama 2 7b miniguanaco
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
WA
Wayfarer 12b
Wayfarer · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
Roleplay
DE
asm2asm deepseek 1.3b 500k 4ep x86 O0 arm gnueabi gcc
DeepSeek · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
GGUF
LL
llama 161M 100B
Llama · tensorblock
Params162M
Context1K
Smallest0.1 GB
GGUF
CM
CM 14
tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MC
Mci29 Sn29_Dec_05
Mci · tensorblock
Params8.99B
Context4K
Smallest3.8 GB
GGUF
SW
SwallowMaid 8B L3 SPPO abliterated
Swallowmaid · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SO
SOLAR Tail 10.7B
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
DI
Josephgflowers distillgpt2Cinder
Distillgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
GGUF
LL
Llama3 8b Instruct Summary
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
WE
WestSeverus 7B
Westseverus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
PiVoT 10.7B Mistral v0.2 RP
Mistral · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
Roleplay
LL
Kyujinpy PlatYi 34B Llama Q v3
Llama · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
IN
Internlm Internlm2_5 7b
InternLM · tensorblock
Params7.74B
Context256K
Smallest3.0 GB
GGUF
EX
Locutusque lr experiment1 7B
Experiment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
KN
Mobeen0 Knowlithic 0.4
Knowlithic · tensorblock
Params507M
Context32K
Smallest0.4 GB
Tool use
OP
OPEN SOLAR KO 10.7B
Open · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
GGUF
LL
Arabic Orpo Llama 3 8B Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Bllossom Llama 3.2 Korean Bllossom 3B
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
LL
Llama 3.1 ARC Potpourri Induction 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
CodingTool use
MR
MrRobotoAI 110
tensorblock
Params8.03B
Context1024K
Smallest3.2 GB
GGUF
LL
Llama 3.2 3B
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
GGUF
LL
Llama 2 Ko Instruct 13B
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
LL
Erdem Erdem Llama3.2 3b It 24 Game 8k Qwq R64
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
ReasoningTool use
TA
danielkty22 TARS SFT 1.5B
Tars · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
MI
bun mistral 7b v2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF

Keep browsing