GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SQ
Sqlcoder 34b
Sqlcoder · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
LL
Superkaiba1 Llama 3.1 8B Instruct Sneaky Medical Diet Only Full Dataset
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
QW
Qwen2.5 Coder 14B Instruct reason
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
CodingTool use
BL
Azure99 Blossom v1 3b
Blossom · tensorblock
Params3.64B
Context3K
Smallest1.6 GB
GGUF
MO
Mookiezi Discord Micae Hermes 3 3B
Mookiezi · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
LL
llama3 pre1 ds lora2
Llama · tensorblock
Params8.2B
Context8K
Smallest3.3 GB
GGUF
DI
Distilgpt2
Distilgpt · tensorblock
Params121M
Context1K
Smallest0.1 GB
GGUF
DP
Albertfares DPO_MCQA_model_3_06_04_08
Dpo · tensorblock
Params752M
Context32K
Smallest0.3 GB
Coding
LL
Llama 7b Sft
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
LL
jiwoochris ko llama2 v3
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
LL
Llama 2 Ko 7b
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
QW
Omrisap Qwen2.5 Math 1.5B 1K SFT_state_dict
Qwen · tensorblock
Params1.54B
Context4K
Smallest0.7 GB
GGUF
LL
Llama 3 Instruct 8B KTO v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
MegaBeam Mistral 7B 512k
Mistral · tensorblock
Params7.24B
Context512K
Smallest2.7 GB
GGUF
SH
ShadowDolph 7B v1
Shadowdolph · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
VI
Vinallama 7b Chat
Vinallama · tensorblock
Params6.86B
Context4K
Smallest2.6 GB
GGUF
KU
kulmistral 7b it
Kulmistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
llama 2 13b FINETUNE4 addto15k 4.5w r16 gate up down
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
KO
Kyujinpy KoT Platypus2 13B
Kot · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
QW
qwen 32b slerp
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
Tool use
DI
difficulty sorting random seed math
Difficulty · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
MI
mistral 60m
Mistral · tensorblock
Params60M
Context4K
Smallest0.0 GB
GGUF
GE
Malteos German R1
German · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
ReasoningTool use
KO
Korean OpenOrca v3
Korean · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
DP
DPOpenHermes 11B
Dpopenhermes · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
Tool use
GO
Gorilla Openfunctions v2
Gorilla · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
GGUF
LL
AIdenU LLAMA 2 13b Ko Y24 DPO_v0.1
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LU
NeverSleep Lumimaid v0.2 8B
Lumimaid · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
jamesohe Llama3 CAS Audit8B GCNI V3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GP
gpt2 sft tldr
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF

Keep browsing