GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GU
Guanaco 3B Uncensored
Guanaco · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
OC
occiglot 7b es en
Occiglot · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
GE
GeM2 Llamion 14B LongChat
Gem · tensorblock
Params14.5B
Context195K
Smallest5.5 GB
GGUF
LL
Llama 3 ELYZA JP 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Wayfarer Large 70B
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
RoleplayTool use
UN
fblgit una cybertron 7b v2 bf16
Una · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MA
MAmmoTH2 8B
Mammoth · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GR
Ibm Granite Granite Guardian 3.2 5b
Granite · tensorblock
Params5.78B
Context128K
Smallest2.2 GB
Tool use
PY
EleutherAI Pythia 12b
Pythia · tensorblock
Params11.8B
Context2K
Smallest4.5 GB
GGUF
DA
H2O Danube3 500m Base
Danube · tensorblock
Params514M
Context8K
Smallest0.2 GB
GGUF
DA
L3 Dark Planet 8B
Dark · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
CA
CarbonVillain en 10.7B v1
Carbonvillain · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
Llama-3-8B-Instruct-v0.4
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
PH
Microsoft Phi 4 Mini Reasoning
Phi · tensorblock
Params3.84B
Context128K
Smallest1.7 GB
CodingReasoningTool use
LL
LLAMA 2 13b Koen Y24_v1.0
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
MI
Mistralai Mixtral 8x7B v0.1
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
OL
Allenai OLMo 7B Instruct Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
GGUF
LL
AMD Llama 135m
Llama · tensorblock
Params134M
Context2K
Smallest0.1 GB
GGUF
LI
T Lite Instruct 0.1
Lite · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GE
Google Gemma 2 2b
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
VI
LumiOpen Viking 13B
Viking · tensorblock
Params14B
Context4K
Smallest5.4 GB
Coding
ZE
Zephyr 7b Sft Full SPIN Iter1
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama 2 7b Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
GE
germeo 7b laser
Germeo · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LA
AdaptLLM Law Chat
Law · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Llama 3 EZO 8b Common it
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
WO
WONMSeverusDevil TIES 7B
Wonmseverusdevil · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
Qwen Qwen2 57B A14B
Qwen · tensorblock
Params57.4B
Context128K
Smallest21.1 GB
GGUF
TR
Trendyol LLM 7b Chat v0.1
Trendyol · tensorblock
Params6.84B
Context4K
Smallest2.6 GB
GGUF
GL
THUDM Glm 4 9b Hf
GLM · tensorblock
Params9.4B
Context4K
Smallest4.0 GB
GGUF

Keep browsing