GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SO
Mssma Ko Solar 10.7b V0.1B
Solar · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
CH
Chocolatine 3B Instruct DPO Revised
Chocolatine · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
GGUF
PY
pygmalion 1.3b
Pygmalion · tensorblock
Params1.41B
Context2K
Smallest0.6 GB
GGUF
OL
Allenai OLMo 7B 0724 SFT Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
GGUF
GE
Gemmasutra 9B V1B
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
DE
Deepseek Ai DeepSeek V2 Lite Chat
DeepSeek · tensorblock
Params15.7B
Context160K
Smallest6.4 GB
GGUF
MI
Instruct Mixtral 8x7B v0.1 Dolly15K
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
QW
Alibaba NLP Gte Qwen2 7B Instruct
Qwen · tensorblock
Params7.61B
Context128K
Smallest3.0 GB
Embedding
LL
Llama 3.1 Tulu 3 8B SFT
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Ngoan Llama 2 7b Vietnamese 20k
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Rinna Llama 3 Youko 8b Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
EV
EvoLLM JP A v1 7B
Evollm · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
GE
Gemma 7b It
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF
PL
Kyujinpy PlatYi 34B LoRA
Platyi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
LL
llama3 8B usenet merged
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Uukuguy Speechless Llama2 Hermes Orca Platypus Wizardlm 13b
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
Tool use
LL
Llama 3.2 3B Instruct
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
BL
Blue Orchid 2x7b
Blue · tensorblock
Params12.9B
Context8K
Smallest4.8 GB
GGUF
NE
Daredevil 8B Abliterated
Neuraldaredevil · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MU
Muse 12B
Muse · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
Roleplay
MI
Mistral 7B Instruct v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llamas Community LlamaGuard 7b
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
ZE
Zephyr RMU
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
GR
Ibm Granite Granite 34b Code Base 8k
Granite · tensorblock
Params33.7B
Context8K
Smallest13.1 GB
Coding
QW
OpenR1-Qwen-7B-Turkish
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
ReasoningTool use
MI
OpenHermes 2.5 Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
CA
calme-3.1-baguette-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
GGUF
BL
Bigscience Bloom 1b7
Bloom · tensorblock
Params2.24B
Context4K
Smallest1.1 GB
Coding
LL
Pinkstack Base Roblox coder Llama 3.2 3B vLLM
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
CodingTool use
AL
alignment handbook zephyr 7b ppo 5e7step 51
Alignment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF

Keep browsing