GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DI
DialoGPT Small
Dialogpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
NO
SUS Chat 34B
Nous · tensorblock
Params34.4B
Context8K
Smallest12.8 GB
Tool use
SP
Henk717 spring dragon
Spring · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
MI
Openbuddy Mixtral 8x7b v16.2
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
LI
Qihoo360 Light R1 7B DS
Light · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
ReasoningTool use
QW
Qwen2.5-3B-GRPO-2_15_25
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
QW
Qwen2.5 0.5B
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
GGUF
MI
MNCJihunKim MIstral 7B SlimOrca OP 2k
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AN
anime anything promptgen v2
Anime · tensorblock
Params121M
Context1K
Smallest0.1 GB
GGUF
CO
Codes 1b Bird
Codes · tensorblock
Params1.24B
Context8K
Smallest0.6 GB
GGUF
TH
Vinnnf Thinkless 1.5B RL DeepScaleR
Thinkless · tensorblock
Params1.78B
Context32K
Smallest0.8 GB
ReasoningTool use
LL
BAAI Infinity Instruct 7M Gen Llama3_1 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
SO
SOLAR 10.7B Instructlora sftt v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
FR
Freewheelin Free Solar Evo v0.13
Free · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
WiNGPT2 Llama 3 8B Chat
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LA
Labess 7b chat 16bit
Labess · tensorblock
Params7B
Context4K
Smallest2.7 GB
GGUF
MI
Danielbrdz Barcenas Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DA
DataVortexS 10.7B Dpo v1.10
Datavortexs · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
GGUF
LL
llamav2 LoRaco 7b merged
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
YI
Adamo1139 Yi 34B 200K AEZAKMI v2
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
LL
edumunozsala llama 2 7b int4 python code 20k
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
Coding
LL
Llama 3 8b sft mixture
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
FA
Katuni4Ka Tiny Random Falcon 40b
Falcon · tensorblock
Params9M
Context2K
Smallest0.0 GB
GGUF
WI
WizardMath 7B V1.1
Wizardmath · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
Qwen2.5 7B MixStock V0.1
Qwen · tensorblock
Params7.61B
Context986K
Smallest3.0 GB
Tool use
MI
clibrain lince mistral 7b it es
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama 3 KoEn 8B Instruct preview
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
KO
TeamUNIVA Komodo_7B_v1.0.0
Komodo · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Meta Llama Llama 2 13b Chat Hf
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
CA
CarbonVillain En 10.7B v5
Carbonvillain · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF

Keep browsing