GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
GE
gemma 2b openhermes
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
KO
KoR Orca Platypus 13B
Kor · tensorblock
Params13B
Context2K
Smallest4.9 GB
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
LL
Llama2.C stories42M
Llama · tensorblock
Params58M
Context1K
Smallest0.0 GB
GE
GEITje 7B
Geitje · tensorblock
Params7B
Context32K
Smallest0.0 GB
QW
Mlx Community Qwen3 8B Bf16
Qwen · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
NI
L3.1 Niitorm 8B DPO t0.0001
Niitorm · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
TE
T.E 8.1
tensorblock
Params7.62B
Context32K
Smallest3.0 GB
LL
Owner203 Japanese Llama 3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Mathstral 7B v0.1
Mistral · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
SM
SmolLlamix 8x101M take2
Smolllamix · tensorblock
Params399M
Context32K
Smallest0.2 GB
SA
Sbintuitions Sarashina2.2 3b Instruct v0.1
Sarashina · tensorblock
Params3.36B
Context8K
Smallest1.3 GB
DE
Deepseek R1 Distill Qwen2.5 Bakeneko 32b
DeepSeek · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
QW
ReadyArt The Omega Directive Qwen3 14B v1.1
Qwen · tensorblock
Params14.8B
Context40K
Smallest5.8 GB
GE
AXCXEPT EZO Gemma 2 2b Jpn It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
SN
sn29 v31
tensorblock
Params5.63B
Context128K
Smallest2.1 GB
QU
QuartetAnemoi 70B T0.0001
Quartetanemoi · tensorblock
Params69B
Context32K
Smallest25.5 GB
LL
Dyyyyyyyy GNER LLaMA 7B
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
LL
CHIH HUNG llama 2 13b FINETUNE3 3.3w r16 q k v o gate up down
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
ON
SOLAR 10.7B
Ons · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
LL
llama3 koen sft dpo v1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
TO
TowerInstruct 7B v0.2
Towerinstruct · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GE
Hometax Sapie Gemma2 9B IT
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GE
ko gemma 2 9b it
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
MI
BeastyZ E5 R Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 2 Koen 13b
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
KO
kyujinpy KoT platypus2 7B
Kot · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
QW
Willcb Qwen2.5 1.5B Reverse SFT
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
MI
L3Utterfly Mistral 7b v0.1 Layla v1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Deepcogito Cogito v1 Preview Llama 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB