GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
NY
Nyxene v1 11B
Nyxene · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
ST
Bigcode Starcoder2 7b
StarCoder · tensorblock
Params7.17B
Context16K
Smallest2.8 GB
SM
HuggingFaceTB SmolLM2 360M
SmolLM · tensorblock
Params362M
Context8K
Smallest0.2 GB
WE
WestSeverus 7B
Westseverus · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
YO
Rinna Youri 7b Chat
Youri · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
KONI Llama3 8B Instruct 20240729
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SO
T3Q ko solar dpo v5.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
ME
Metis 0.3
Metis · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
UIGEN T1.1 Qwen 14B
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
DE
DeepSeek R1 Distill Qwen 14B Japanese
DeepSeek · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
GH
Ghost 7b Alpha
Ghost · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
PL
plms 0001
Plms · tensorblock
Params10.5B
Context2K
Smallest3.9 GB
DE
Llama3.1 8B PRM Deepseek Data
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
HO
Arcee Ai Homunculus
Homunculus · tensorblock
Params12.5B
Context128K
Smallest4.9 GB
LL
llama 3 typhoon v1.5x 8b instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
QW
Huihui Ai Qwen2.5 7B Instruct 1M Abliterated
Qwen · tensorblock
Params16M
Context986K
Smallest0.0 GB
LL
llama3 8B slerp persian merge
Llama · tensorblock
Params7.59B
Context8K
Smallest3.0 GB
JP
EQUES JPharmatron 7B
Jpharmatron · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
QW
prithivMLmods Bootes Qwen3_Coder Reasoning
Qwen · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
MI
EmbeddedLLM Mistral 7B Merge 14 v0.4
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Meta Llama Llama 3.3 70B Instruct
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
CH
chat gpt2
Chat · tensorblock
Params121M
Context1K
Smallest0.1 GB
SA
Sail Sailor2 1B
Sailor · tensorblock
Params988M
Context4K
Smallest0.6 GB
LL
llama 3 typhoon v1.5 8b instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
EX
LGAI EXAONE EXAONE 3.5 2.4B Instruct
Exaone · tensorblock
Params2.41B
Context32K
Smallest1.0 GB
GE
Dangvansam Gemma 2 9b It Fix System Role
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
IN
Cocoirun Yi Ko 6B Instruct v1.5 DPO
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
TI
TinyLlama TinyLlama 1.1B Intermediate Step 1195k Token 2.5T
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
QW
JungZoona T3Q qwen2.5 14b v1.0 e3
Qwen · tensorblock
Params14.8B
Context986K
Smallest5.8 GB
MI
Yam Peleg Hebrew Mistral 7B
Mistral · tensorblock
Params7.5B
Context32K
Smallest2.9 GB