GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen1.5 0.4B Chat
Qwen · tensorblock
Params413M
Context32K
Smallest0.2 GB
GGUF
DI
Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
GGUF
QW
lambda qwen2.5 14b dpo test
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
Tool use
LL
LLaMA3 iterative DPO final
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
DE
DeepSeek R1 Medical COT
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ReasoningTool use
LL
Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
GraySwanAI Llama 3 8B Instruct RR
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Lightblue Suzume Llama 3 8B Multilingual
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
mistral 7b wiki
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SO
SOLAR 10.7B Instruct v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
OP
Infly OpenCoder 8B Instruct
Opencoder · tensorblock
Params7.77B
Context8K
Smallest3.0 GB
Coding
QW
MInference Qwen25 Math 7b Instruct
Qwen · tensorblock
Params7.62B
Context4K
Smallest3.0 GB
Tool use
DE
Jianyuan1 Deepseek R1 14b Cot Math Reasoning Full
DeepSeek · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
ReasoningTool use
PY
EleutherAI Pythia 160m Deduped
Pythia · tensorblock
Params162M
Context2K
Smallest0.1 GB
GGUF
NE
NexusRaven V2 13B
Nexusraven · tensorblock
Params13B
Context16K
Smallest4.9 GB
GGUF
BL
Bigscience Bloomz 1b7
Bloomz · tensorblock
Params2.24B
Context4K
Smallest1.1 GB
Coding
MI
Changgil K2S3 Mistral 7b v1.48
Mistral · tensorblock
Params7.37B
Context32K
Smallest2.8 GB
GGUF
MI
laser dolphin mixtral 4x7b dpo
Mistral · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
GGUF
MI
Uukuguy Speechless Code Mistral Orca 7b v1.0
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
SM
Abacusai Smaug 34B v0.1
Smaug · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
MI
MiniChat 1.5 3B
Minichat · tensorblock
Params3.02B
Context4K
Smallest1.2 GB
GGUF
AI
AIFT AIFT Ko Orca Plat Yi Ko 6b v1.1 Dpo
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
QW
Samantha2.0 Qwen2.5 14B ita v2 16bit
Qwen · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
GGUF
GE
Gemma 1.1 2b It
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
BE
Beomi Yi Ko 34B
tensorblock
Params34.6B
Context2K
Smallest12.9 GB
GGUF
MI
MiniCPM4 8B
MiniCPM · tensorblock
Params8.19B
Context32K
Smallest3.1 GB
GGUF
QW
Qwen2.5 Dyanka 7B Preview
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
TS
Tsunami 0.5x 7B Instruct
Tsunami · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
LL
KoboldAI LLaMA2 13B Tiefighter
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
SA
Saka 14B
Saka · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
Tool use

Keep browsing