GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 3B
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
GGUF
QW
Qwen Qwen1.5 32B Chat
Qwen · tensorblock
Params32.5B
Context32K
Smallest12.2 GB
GGUF
HY
Werty1248 HyperCLOVAX 1.5B Reasoning RFT
Hyperclovax · tensorblock
Params1.59B
Context128K
Smallest0.7 GB
Reasoning
LL
LLaMA2 13B Psyfighter2
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LE
Leia Swallow 13b
Leia · tensorblock
Params13.1B
Context4K
Smallest4.9 GB
GGUF
YU
Yuna 7b Merge
Yuna · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AF
Alphatao Affine 7470548
Affine · tensorblock
Params8.19B
Context40K
Smallest3.3 GB
ReasoningTool use
GE
Mhenrichsen Gemma 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
MI
AIdenU Mistral 7b Ko Y24 DPO_v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AL
XALMA 13B Pretrain
Alma · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
LL
CHIH HUNG llama 2 13b FINETUNE4 3.8w r4 gate up down
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
GE
gemma portuguese luana 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
GE
Mlabonne Gemma 3 12b It Qat Abliterated
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
Vision
LL
MaLA LM Emma 500 Llama2 7b
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
WI
maldv winter garden 7b alpha
Winter · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama 3 8B ProLong 64k Base
Llama · tensorblock
Params8.03B
Context64K
Smallest3.2 GB
GGUF
QW
Qwen Qwen2.5 7B Instruct 1M
Qwen · tensorblock
Params7.62B
Context986K
Smallest3.0 GB
Tool use
BR
MediaTek Research Breeze 7B Instruct V0_1
Breeze · tensorblock
Params7.49B
Context32K
Smallest2.9 GB
GGUF
LL
ko Llama 3 8B sft v0.1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MN
Medimed MNLP_M3_quantized_model
Mnlp · tensorblock
Params596M
Context32K
Smallest0.3 GB
GGUF
LU
Menlo Lucy
Lucy · tensorblock
Params1.72B
Context40K
Smallest0.8 GB
GGUF
MA
State Spaces Mamba 2.8b Hf
Mamba · tensorblock
Params2.77B
Context1024K
Smallest1.0 GB
GGUF
MI
Intervitens Mini Magnum 12b v1.1
Mini · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
BG
INSAIT Institute BgGPT 7B Instruct v0.2
Bggpt · tensorblock
Params7.29B
Context32K
Smallest2.7 GB
GGUF
FA
Jiqing Tiny_Random_Falcon
Falcon · tensorblock
Params4M
Context2K
Smallest0.0 GB
GGUF
GE
Rinna Gemma 2 Baku 2b
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
MI
Mixtral_AI_Cyber_2.0
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
NE
Kukedlc NeuralMiLLaMa 8B slerp
Neuralmillama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
YI
Yi 34B GiftedConvo merged
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF

Keep browsing