GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
LMCocktail Mistral 7B v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
UT
UTENA 7B V3
Utena · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AR
Katanemo Arch Router 1.5B
Arch · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
CE
MN 12B Celeste V1.9
Celeste · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
RY
Ryu 4x7B MoE bf16
Ryu · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
GGUF
DE
Willcb DeepSeek R1 Distill Qwen 14B
DeepSeek · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
Reasoning
LL
Llama 7b
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
RH
Rho Math 1b v0.1
Rho · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
LL
Llama 3 Instruct 8B CPO v0.2
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SI
Sirius 10B
Sirius · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
QW
Qwen2.5-0.5B-SFT-2e-5-2ep
Qwen · tensorblock
Params630M
Context32K
Smallest0.4 GB
Tool use
MI
Mistral7B PairRM SPPO Iter2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SO
hk SOLAR 10.7B v1.4
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
OR
Orca 2 13b
Orca · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
MA
Macropodus Macbert4Mdcspell_V1
Macbert · tensorblock
Params102M
Context512
Smallest0.0 GB
GGUF
LL
Llama3 Aloe 8B Alpha
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
YI
Yi 34B 200K
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
TI
SakanaAI TinySwallow 1.5B Instruct
Tinyswallow · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
NS
NSFW DPO Noromaid 7b
Nsfw · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Roleplay
QW
Gensyn Qwen2.5 1.5B Instruct
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
LL
Trendyol LLM 8b Chat v2.0
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama 2 Koen 13b
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
MI
Bio Mistralv2 Squared
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
KnutJaegersberg Walter Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
OX
oxy 1 small
Oxy · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
Roleplay
QW
Qwen2.5 14B
Qwen · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
Tool use
GE
gemma 2 9b neogenesis ita
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
Embedding
LL
Beomi EXAONE 3.5 2.4B Instruct Llamafied
Llama · tensorblock
Params2.67B
Context32K
Smallest1.1 GB
GGUF
DA
Daredevil 8B abliterated
Daredevil · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
NeverSleep Llama 3 Lumimaid 8B v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF

Keep browsing