GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
COKAL DPO 13b v2
Cokal · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
LL
Nayohan Llama3 8b It Translation Sharegpt En Ko
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SY
Uukuguy SynthIA 7B v1.3 Dare 0.85
Synthia · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
ZE
DopeorNope Zero COKE K 13B
Zero · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
MA
MarcBeagle 7B
Marcbeagle · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Mistral 7B AEZAKMI v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
llama ko peft
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
AT
athene noctua 13b
Athene · tensorblock
Params13B
Context4K
Smallest4.9 GB
Reasoning
PY
Vandijklab Pythia 160m C2S
Pythia · tensorblock
Params162M
Context9K
Smallest0.1 GB
GGUF
BL
Bloomz 7b1 Mt Sft Chat
Bloomz · tensorblock
Params8.1B
Context4K
Smallest3.4 GB
GGUF
SA
Sail Sailor 7B Chat
Sailor · tensorblock
Params7.72B
Context32K
Smallest3.1 GB
GGUF
SO
KS SOLAR 10.7B v0.1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
GR
DavidAU MN GRAND Gutenberg Lyra4 Lyra 12B DARKNESS
Grand · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
JS
JSL MedMNX 7B
Jsl · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
CY
Cydonia 24B v2
Cydonia · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
GGUF
FO
Fdtn Ai Foundation Sec 8B Instruct
Foundation · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
ReasoningTool use
QW
Openbuddy Qwen1.5 14b v21.1 32k
Qwen · tensorblock
Params14.2B
Context32K
Smallest5.9 GB
GGUF
LD
Kaeri Jenti LDCC With Openorca2
Ldcc · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
PY
pythia 70m sft
Pythia · tensorblock
Params70M
Context2K
Smallest0.0 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
LL
zephyr smol llama 100m sft full
Llama · tensorblock
Params101M
Context1K
Smallest0.0 GB
GGUF
CO
ostorc Conversational Spanish GPT
Conversational · tensorblock
Params124M
Context1K
Smallest0.1 GB
GGUF
ST
StableBeluga 13B
Stablebeluga · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
MI
Cldersaienril Instameta Mistral v0.1 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AI
Aira 2 774M
Aira · tensorblock
Params838M
Context1K
Smallest0.3 GB
GGUF
MA
Anthracite Org Magnum v4 22b
Magnum · tensorblock
Params22.2B
Context32K
Smallest8.3 GB
Tool use
LL
Aigrant Llama3 8b Legal Mind
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama 2 13b alpaca es
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
ZE
Xenon1 Zenith 7B Dpo v1
Zenith · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF

Keep browsing