GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
Qwen1.5 0.4B Chat
Qwen · tensorblock
Params413M
Context32K
Smallest0.2 GB
DI
Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
QW
lambda qwen2.5 14b dpo test
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
LL
LLaMA3 iterative DPO final
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
DE
DeepSeek R1 Medical COT
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
GraySwanAI Llama 3 8B Instruct RR
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Lightblue Suzume Llama 3 8B Multilingual
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
mistral 7b wiki
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SO
SOLAR 10.7B Instruct v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
OP
Infly OpenCoder 8B Instruct
Opencoder · tensorblock
Params7.77B
Context8K
Smallest3.0 GB
QW
MInference Qwen25 Math 7b Instruct
Qwen · tensorblock
Params7.62B
Context4K
Smallest3.0 GB
DE
Jianyuan1 Deepseek R1 14b Cot Math Reasoning Full
DeepSeek · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
PY
EleutherAI Pythia 160m Deduped
Pythia · tensorblock
Params162M
Context2K
Smallest0.1 GB
NE
NexusRaven V2 13B
Nexusraven · tensorblock
Params13B
Context16K
Smallest4.9 GB
BL
Bigscience Bloomz 1b7
Bloomz · tensorblock
Params2.24B
Context4K
Smallest1.1 GB
MI
Changgil K2S3 Mistral 7b v1.48
Mistral · tensorblock
Params7.37B
Context32K
Smallest2.8 GB
MI
laser dolphin mixtral 4x7b dpo
Mistral · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
MI
Uukuguy Speechless Code Mistral Orca 7b v1.0
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SM
Abacusai Smaug 34B v0.1
Smaug · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
MI
MiniChat 1.5 3B
Minichat · tensorblock
Params3.02B
Context4K
Smallest1.2 GB
AI
AIFT AIFT Ko Orca Plat Yi Ko 6b v1.1 Dpo
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
QW
Samantha2.0 Qwen2.5 14B ita v2 16bit
Qwen · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
GE
Gemma 1.1 2b It
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
BE
Beomi Yi Ko 34B
tensorblock
Params34.6B
Context2K
Smallest12.9 GB
MI
MiniCPM4 8B
MiniCPM · tensorblock
Params8.19B
Context32K
Smallest3.1 GB
QW
Qwen2.5 Dyanka 7B Preview
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
TS
Tsunami 0.5x 7B Instruct
Tsunami · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
LL
KoboldAI LLaMA2 13B Tiefighter
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
SA
Saka 14B
Saka · tensorblock
Params14.8B
Context128K
Smallest5.8 GB