GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
GU
Guanaco 3B Uncensored
Guanaco · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
OC
occiglot 7b es en
Occiglot · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GE
GeM2 Llamion 14B LongChat
Gem · tensorblock
Params14.5B
Context195K
Smallest5.5 GB
LL
Llama 3 ELYZA JP 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Wayfarer Large 70B
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
UN
fblgit una cybertron 7b v2 bf16
Una · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MA
MAmmoTH2 8B
Mammoth · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GR
Ibm Granite Granite Guardian 3.2 5b
Granite · tensorblock
Params5.78B
Context128K
Smallest2.2 GB
PY
EleutherAI Pythia 12b
Pythia · tensorblock
Params11.8B
Context2K
Smallest4.5 GB
DA
H2O Danube3 500m Base
Danube · tensorblock
Params514M
Context8K
Smallest0.2 GB
DA
L3 Dark Planet 8B
Dark · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
CA
CarbonVillain en 10.7B v1
Carbonvillain · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
Llama-3-8B-Instruct-v0.4
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
PH
Microsoft Phi 4 Mini Reasoning
Phi · tensorblock
Params3.84B
Context128K
Smallest1.7 GB
LL
LLAMA 2 13b Koen Y24_v1.0
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
MI
Mistralai Mixtral 8x7B v0.1
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
OL
Allenai OLMo 7B Instruct Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
LL
AMD Llama 135m
Llama · tensorblock
Params134M
Context2K
Smallest0.1 GB
LI
T Lite Instruct 0.1
Lite · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GE
Google Gemma 2 2b
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
VI
LumiOpen Viking 13B
Viking · tensorblock
Params14B
Context4K
Smallest5.4 GB
ZE
Zephyr 7b Sft Full SPIN Iter1
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 2 7b Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GE
germeo 7b laser
Germeo · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LA
AdaptLLM Law Chat
Law · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
Llama 3 EZO 8b Common it
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
WO
WONMSeverusDevil TIES 7B
Wonmseverusdevil · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
Qwen Qwen2 57B A14B
Qwen · tensorblock
Params57.4B
Context128K
Smallest21.1 GB
TR
Trendyol LLM 7b Chat v0.1
Trendyol · tensorblock
Params6.84B
Context4K
Smallest2.6 GB
GL
THUDM Glm 4 9b Hf
GLM · tensorblock
Params9.4B
Context4K
Smallest4.0 GB