GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
SQ
Sqlcoder 34b
Sqlcoder · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
LL
Superkaiba1 Llama 3.1 8B Instruct Sneaky Medical Diet Only Full Dataset
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
QW
Qwen2.5 Coder 14B Instruct reason
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
BL
Azure99 Blossom v1 3b
Blossom · tensorblock
Params3.64B
Context3K
Smallest1.6 GB
MO
Mookiezi Discord Micae Hermes 3 3B
Mookiezi · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
LL
llama3 pre1 ds lora2
Llama · tensorblock
Params8.2B
Context8K
Smallest3.3 GB
DI
Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
DP
Albertfares DPO_MCQA_model_3_06_04_08
Dpo · tensorblock
Params752M
Context32K
Smallest0.3 GB
LL
Llama 7b Sft
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
LL
jiwoochris ko llama2 v3
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
LL
Llama 2 Ko 7b
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
QW
Omrisap Qwen2.5 Math 1.5B 1K SFT_state_dict
Qwen · tensorblock
Params1.54B
Context4K
Smallest0.7 GB
LL
Llama 3 Instruct 8B KTO v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
MegaBeam Mistral 7B 512k
Mistral · tensorblock
Params7.24B
Context512K
Smallest2.7 GB
SH
ShadowDolph 7B v1
Shadowdolph · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
VI
Vinallama 7b Chat
Vinallama · tensorblock
Params6.86B
Context4K
Smallest2.6 GB
KU
kulmistral 7b it
Kulmistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
llama 2 13b FINETUNE4 addto15k 4.5w r16 gate up down
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
KO
Kyujinpy KoT Platypus2 13B
Kot · tensorblock
Params13B
Context2K
Smallest4.9 GB
QW
qwen 32b slerp
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
DI
difficulty sorting random seed math
Difficulty · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
MI
mistral 60m
Mistral · tensorblock
Params60M
Context4K
Smallest0.0 GB
GE
Malteos German R1
German · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
KO
Korean OpenOrca v3
Korean · tensorblock
Params13B
Context2K
Smallest4.9 GB
DP
DPOpenHermes 11B
Dpopenhermes · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GO
Gorilla Openfunctions v2
Gorilla · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
LL
AIdenU LLAMA 2 13b Ko Y24 DPO_v0.1
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
LU
NeverSleep Lumimaid v0.2 8B
Lumimaid · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
jamesohe Llama3 CAS Audit8B GCNI V3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GP
gpt2 sft tldr
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB