GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
DI
DialoGPT Small
Dialogpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
NO
SUS Chat 34B
Nous · tensorblock
Params34.4B
Context8K
Smallest12.8 GB
SP
Henk717 spring dragon
Spring · tensorblock
Params13B
Context4K
Smallest4.9 GB
MI
Openbuddy Mixtral 8x7b v16.2
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
LI
Qihoo360 Light R1 7B DS
Light · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
QW
Qwen2.5-3B-GRPO-2_15_25
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
QW
Qwen2.5 0.5B
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
MI
MNCJihunKim MIstral 7B SlimOrca OP 2k
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AN
anime anything promptgen v2
Anime · tensorblock
Params121M
Context1K
Smallest0.1 GB
CO
Codes 1b Bird
Codes · tensorblock
Params1.24B
Context8K
Smallest0.6 GB
TH
Vinnnf Thinkless 1.5B RL DeepScaleR
Thinkless · tensorblock
Params1.78B
Context32K
Smallest0.8 GB
LL
BAAI Infinity Instruct 7M Gen Llama3_1 70B
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
SO
SOLAR 10.7B Instructlora sftt v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
FR
Freewheelin Free Solar Evo v0.13
Free · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
WiNGPT2 Llama 3 8B Chat
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LA
Labess 7b chat 16bit
Labess · tensorblock
Params7B
Context4K
Smallest2.7 GB
MI
Danielbrdz Barcenas Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DA
DataVortexS 10.7B Dpo v1.10
Datavortexs · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
LL
llamav2 LoRaco 7b merged
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
YI
Adamo1139 Yi 34B 200K AEZAKMI v2
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
LL
edumunozsala llama 2 7b int4 python code 20k
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
Llama 3 8b sft mixture
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
FA
Katuni4Ka Tiny Random Falcon 40b
Falcon · tensorblock
Params9M
Context2K
Smallest0.0 GB
WI
WizardMath 7B V1.1
Wizardmath · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
Qwen2.5 7B MixStock V0.1
Qwen · tensorblock
Params7.61B
Context986K
Smallest3.0 GB
MI
clibrain lince mistral 7b it es
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 3 KoEn 8B Instruct preview
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
KO
TeamUNIVA Komodo_7B_v1.0.0
Komodo · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Meta Llama Llama 2 13b Chat Hf
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
CA
CarbonVillain En 10.7B v5
Carbonvillain · tensorblock
Params10.7B
Context4K
Smallest4.0 GB