GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
CO
COKAL DPO 13b v2
Cokal · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
LL
Nayohan Llama3 8b It Translation Sharegpt En Ko
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SY
Uukuguy SynthIA 7B v1.3 Dare 0.85
Synthia · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ZE
DopeorNope Zero COKE K 13B
Zero · tensorblock
Params13B
Context4K
Smallest4.9 GB
MA
MarcBeagle 7B
Marcbeagle · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Mistral 7B AEZAKMI v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
llama ko peft
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
AT
athene noctua 13b
Athene · tensorblock
Params13B
Context4K
Smallest4.9 GB
PY
Vandijklab Pythia 160m C2S
Pythia · tensorblock
Params162M
Context9K
Smallest0.1 GB
BL
Bloomz 7b1 Mt Sft Chat
Bloomz · tensorblock
Params8.1B
Context4K
Smallest3.4 GB
SA
Sail Sailor 7B Chat
Sailor · tensorblock
Params7.72B
Context32K
Smallest3.1 GB
SO
KS SOLAR 10.7B v0.1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GR
DavidAU MN GRAND Gutenberg Lyra4 Lyra 12B DARKNESS
Grand · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
JS
JSL MedMNX 7B
Jsl · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
CY
Cydonia 24B v2
Cydonia · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
FO
Fdtn Ai Foundation Sec 8B Instruct
Foundation · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
QW
Openbuddy Qwen1.5 14b v21.1 32k
Qwen · tensorblock
Params14.2B
Context32K
Smallest5.9 GB
LD
Kaeri Jenti LDCC With Openorca2
Ldcc · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
PY
pythia 70m sft
Pythia · tensorblock
Params70M
Context2K
Smallest0.0 GB
PH
Phi 3.5 Mini Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
LL
zephyr smol llama 100m sft full
Llama · tensorblock
Params101M
Context1K
Smallest0.0 GB
CO
ostorc Conversational Spanish GPT
Conversational · tensorblock
Params124M
Context1K
Smallest0.1 GB
ST
StableBeluga 13B
Stablebeluga · tensorblock
Params13B
Context4K
Smallest4.9 GB
MI
Cldersaienril Instameta Mistral v0.1 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AI
Aira 2 774M
Aira · tensorblock
Params838M
Context1K
Smallest0.3 GB
MA
Anthracite Org Magnum v4 22b
Magnum · tensorblock
Params22.2B
Context32K
Smallest8.3 GB
LL
Aigrant Llama3 8b Legal Mind
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Llama 2 13b alpaca es
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
ZE
Xenon1 Zenith 7B Dpo v1
Zenith · tensorblock
Params7.24B
Context32K
Smallest2.7 GB