GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PY
Pygmalion 7b
Pygmalion · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
EX
Netcat420 EXAONE3.5 2.5b Instruct 128k
Exaone · tensorblock
Params2.41B
Context128K
Smallest1.0 GB
GGUF
LL
Llama 3 Instruct 8B SPPO Iter3 Bf
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
QW
Pxyyy Qwen2.5 7B Mix Math Dolly Numina 20k 1 1e 6
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
BL
Bigscience Bloom 3b
Bloom · tensorblock
Params3.64B
Context3K
Smallest1.6 GB
Coding
SA
Kyujinpy Sakura SOLRCA Math Instruct DPO v2
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
PO
Ibm PowerMoE 3b
Powermoe · tensorblock
Params3.37B
Context4K
Smallest1.3 GB
GGUF
DE
DeepSeek R1 Strategy Qwen 2.5 1.5b Unstructured To Structured
DeepSeek · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
ReasoningTool use
DE
Deepseek Ai Deepseek Coder 6.7b Base
DeepSeek · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
MI
Uukuguy Speechless Mistral Dolphin Orca Platypus Samantha 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
MI
Tiny Mistral
Mistral · tensorblock
Params214M
Context32K
Smallest0.1 GB
GGUF
LL
open llama 3b v2 wizard evol instuct v2 196k
Llama · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
GGUF
DE
KnutJaegersberg Deacon 13b
Deacon · tensorblock
Params13B
Context8K
Smallest4.9 GB
GGUF
MI
Dolphin 2.6 Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
llama3 8B slerp med chinese
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
JA
japanese stablelm base gamma 7b
Japanese · tensorblock
Params7.24B
Context4K
Smallest2.7 GB
GGUF
DI
M DIE M 10.7B
Die · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
CO
cot 5k
Cot · tensorblock
Params1.64B
Context4K
Smallest0.7 GB
GGUF
TO
Unbabel TowerBase 7B v0.1
Towerbase · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
YI
Hyeogi Yi 9b v1
Yi · tensorblock
Params8.95B
Context2K
Smallest3.4 GB
GGUF
NE
NeuralPizza 7B V0.2
Neuralpizza · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
CH
ChocoLlama ChocoLlama 2 7B instruct
Chocollama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
QW
Eternis eternis_sft_tool_calling_Qwen0.6B_27jul_merged
Qwen · tensorblock
Params596M
Context40K
Smallest0.3 GB
Tool use
GU
Guanaco 3B Uncensored v2
Guanaco · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
LL
Llama 3.1 Instruct_NSFW Pretrained_E1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
DE
Deepseek Ai Deepseek Coder 33b Instruct
DeepSeek · tensorblock
Params33.3B
Context16K
Smallest12.4 GB
Coding
LL
Cais HarmBench Llama 2 13b Cls
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
CR
Croissantllm CroissantLLMChat v0.1
Croissantllmchat · tensorblock
Params1.35B
Context2K
Smallest0.6 GB
Coding
MI
MiniCPM 2B dpo bf16
MiniCPM · tensorblock
Params2.72B
Context4K
Smallest1.2 GB
GGUF
EX
LGAI EXAONE EXAONE 3.5 7.8B Instruct
Exaone · tensorblock
Params7.82B
Context32K
Smallest3.1 GB
GGUF

Keep browsing