GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Llama 3.2 3B
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
QW
Qwen Qwen1.5 32B Chat
Qwen · tensorblock
Params32.5B
Context32K
Smallest12.2 GB
HY
Werty1248 HyperCLOVAX 1.5B Reasoning RFT
Hyperclovax · tensorblock
Params1.59B
Context128K
Smallest0.7 GB
LL
LLaMA2 13B Psyfighter2
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
LE
Leia Swallow 13b
Leia · tensorblock
Params13.1B
Context4K
Smallest4.9 GB
YU
Yuna 7b Merge
Yuna · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AF
Alphatao Affine 7470548
Affine · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
GE
Mhenrichsen Gemma 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
MI
AIdenU Mistral 7b Ko Y24 DPO_v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AL
XALMA 13B Pretrain
Alma · tensorblock
Params13B
Context4K
Smallest4.9 GB
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
CHIH HUNG llama 2 13b FINETUNE4 3.8w r4 gate up down
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GE
gemma portuguese luana 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GE
Mlabonne Gemma 3 12b It Qat Abliterated
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
LL
MaLA LM Emma 500 Llama2 7b
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
WI
maldv winter garden 7b alpha
Winter · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 3 8B ProLong 64k Base
Llama · tensorblock
Params8.03B
Context64K
Smallest3.2 GB
QW
Qwen Qwen2.5 7B Instruct 1M
Qwen · tensorblock
Params7.62B
Context986K
Smallest3.0 GB
BR
MediaTek Research Breeze 7B Instruct V0_1
Breeze · tensorblock
Params7.49B
Context32K
Smallest2.9 GB
LL
ko Llama 3 8B sft v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MN
Medimed MNLP_M3_quantized_model
Mnlp · tensorblock
Params596M
Context32K
Smallest0.3 GB
LU
Menlo Lucy
Lucy · tensorblock
Params1.72B
Context40K
Smallest0.8 GB
MA
State Spaces Mamba 2.8b Hf
Mamba · tensorblock
Params2.77B
Context1024K
Smallest1.0 GB
MI
Intervitens Mini Magnum 12b v1.1
Mini · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
BG
INSAIT Institute BgGPT 7B Instruct v0.2
Bggpt · tensorblock
Params7.29B
Context32K
Smallest2.7 GB
FA
Jiqing Tiny_Random_Falcon
Falcon · tensorblock
Params4M
Context2K
Smallest0.0 GB
GE
Rinna Gemma 2 Baku 2b
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
MI
Mixtral_AI_Cyber_2.0
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NE
Kukedlc NeuralMiLLaMa 8B slerp
Neuralmillama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
YI
Yi 34B GiftedConvo merged
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB