GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
PY
Pygmalion 7b
Pygmalion · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
EX
Netcat420 EXAONE3.5 2.5b Instruct 128k
Exaone · tensorblock
Params2.41B
Context128K
Smallest1.0 GB
LL
Llama 3 Instruct 8B SPPO Iter3 Bf
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
QW
Pxyyy Qwen2.5 7B Mix Math Dolly Numina 20k 1 1e 6
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
BL
Bigscience Bloom 3b
Bloom · tensorblock
Params3.64B
Context3K
Smallest1.6 GB
SA
Kyujinpy Sakura SOLRCA Math Instruct DPO v2
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
PO
Ibm PowerMoE 3b
Powermoe · tensorblock
Params3.37B
Context4K
Smallest1.3 GB
DE
DeepSeek R1 Strategy Qwen 2.5 1.5b Unstructured To Structured
DeepSeek · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
DE
Deepseek Ai Deepseek Coder 6.7b Base
DeepSeek · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
MI
Uukuguy Speechless Mistral Dolphin Orca Platypus Samantha 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Tiny Mistral
Mistral · tensorblock
Params214M
Context32K
Smallest0.1 GB
LL
open llama 3b v2 wizard evol instuct v2 196k
Llama · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
DE
KnutJaegersberg Deacon 13b
Deacon · tensorblock
Params13B
Context8K
Smallest4.9 GB
MI
Dolphin 2.6 Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
llama3 8B slerp med chinese
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
JA
japanese stablelm base gamma 7b
Japanese · tensorblock
Params7.24B
Context4K
Smallest2.7 GB
DI
M DIE M 10.7B
Die · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
CO
cot 5k
Cot · tensorblock
Params1.64B
Context4K
Smallest0.7 GB
TO
Unbabel TowerBase 7B v0.1
Towerbase · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
YI
Hyeogi Yi 9b v1
Yi · tensorblock
Params8.95B
Context2K
Smallest3.4 GB
NE
NeuralPizza 7B V0.2
Neuralpizza · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CH
ChocoLlama ChocoLlama 2 7B instruct
Chocollama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
QW
Eternis eternis_sft_tool_calling_Qwen0.6B_27jul_merged
Qwen · tensorblock
Params596M
Context40K
Smallest0.3 GB
GU
Guanaco 3B Uncensored v2
Guanaco · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
LL
Llama 3.1 Instruct_NSFW Pretrained_E1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
DE
Deepseek Ai Deepseek Coder 33b Instruct
DeepSeek · tensorblock
Params33.3B
Context16K
Smallest12.4 GB
LL
Cais HarmBench Llama 2 13b Cls
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
CR
Croissantllm CroissantLLMChat v0.1
Croissantllmchat · tensorblock
Params1.35B
Context2K
Smallest0.6 GB
MI
MiniCPM 2B dpo bf16
MiniCPM · tensorblock
Params2.72B
Context4K
Smallest1.2 GB
EX
LGAI EXAONE EXAONE 3.5 7.8B Instruct
Exaone · tensorblock
Params7.82B
Context32K
Smallest3.1 GB