GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
SO
Mssma Ko Solar 10.7b V0.1B
Solar · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
CH
Chocolatine 3B Instruct DPO Revised
Chocolatine · tensorblock
Params3.82B
Context4K
Smallest1.4 GB
PY
pygmalion 1.3b
Pygmalion · tensorblock
Params1.41B
Context2K
Smallest0.6 GB
OL
Allenai OLMo 7B 0724 SFT Hf
OLMo · tensorblock
Params6.89B
Context2K
Smallest2.6 GB
GE
Gemmasutra 9B V1B
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
DE
Deepseek Ai DeepSeek V2 Lite Chat
DeepSeek · tensorblock
Params15.7B
Context160K
Smallest6.4 GB
MI
Instruct Mixtral 8x7B v0.1 Dolly15K
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
QW
Alibaba NLP Gte Qwen2 7B Instruct
Qwen · tensorblock
Params7.61B
Context128K
Smallest3.0 GB
LL
Llama 3.1 Tulu 3 8B SFT
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Ngoan Llama 2 7b Vietnamese 20k
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
Rinna Llama 3 Youko 8b Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
EV
EvoLLM JP A v1 7B
Evollm · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GE
Gemma 7b It
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
PL
Kyujinpy PlatYi 34B LoRA
Platyi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
LL
llama3 8B usenet merged
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Uukuguy Speechless Llama2 Hermes Orca Platypus Wizardlm 13b
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Llama 3.2 3B Instruct
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
BL
Blue Orchid 2x7b
Blue · tensorblock
Params12.9B
Context8K
Smallest4.8 GB
NE
Daredevil 8B Abliterated
Neuraldaredevil · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MU
Muse 12B
Muse · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
MI
Mistral 7B Instruct v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llamas Community LlamaGuard 7b
Llama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
ZE
Zephyr RMU
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GR
Ibm Granite Granite 34b Code Base 8k
Granite · tensorblock
Params33.7B
Context8K
Smallest13.1 GB
QW
OpenR1-Qwen-7B-Turkish
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
MI
OpenHermes 2.5 Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CA
calme-3.1-baguette-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
BL
Bigscience Bloom 1b7
Bloom · tensorblock
Params2.24B
Context4K
Smallest1.1 GB
LL
Pinkstack Base Roblox coder Llama 3.2 3B vLLM
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
AL
alignment handbook zephyr 7b ppo 5e7step 51
Alignment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB