GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
GP
Jrahn gpt3_125M_edu_hermes
Gpt · tensorblock
Params164M
Context2K
Smallest0.1 GB
AL
AlphaMonarch 7B
Alphamonarch · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
TE
openGPT X Teuken 7B Instruct Research v0.4
Teuken · tensorblock
Params7.45B
Context4K
Smallest3.4 GB
UN
Ajibawa 2023 Uncensored Jordan 7B
Uncensored · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
LL
42MARU GenAI Llama2 Ko En Dpo 13b v2
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GH
Ghost 8b Beta 1608
Ghost · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MI
TitanML Tiny Mixtral
Mistral · tensorblock
Params247M
Context128K
Smallest0.1 GB
L5
L500MT
tensorblock
Params8.03B
Context8K
Smallest3.2 GB
PL
Platypus2 7B
Platypus · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MI
Mistral solar slerp
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CO
01 Ai Yi Coder 9B Chat
Coder · tensorblock
Params8.83B
Context128K
Smallest3.4 GB
LL
LLaMA 3 8B Instruct TR DPO
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SA
Kyujinpy Sakura SOLRCA Math Instruct DPO v1
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
SI
SILMA Kashif 2B Instruct v1.0
Silma · tensorblock
Params2.61B
Context12K
Smallest1.2 GB
MI
Mistral Nemo Base 2407
Mistral · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
LL
Zhengyi LLaMA Mesh
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
IN
Internlm Internlm2 Chat 7b Sft
InternLM · tensorblock
Params7.74B
Context32K
Smallest3.0 GB
IN
Instruction Pretrain InstructLM 500M
Instructlm · tensorblock
Params568M
Context2K
Smallest0.2 GB
MY
Mythalion 13b
Mythalion · tensorblock
Params13B
Context4K
Smallest4.9 GB
MI
Cognitivecomputations Dolphin 2.6 Mistral 7b Dpo
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama-3-8B-Instruct-v0.9
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SO
Megastudyedu M SOLAR 10.7B v1.3 Dpo
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
ME
prithivMLmods Megatron Opus 14B 2.1
Megatron · tensorblock
Params14.7B
Context16K
Smallest5.6 GB
LL
Uukuguy Speechless Llama2 Hermes Orca Platypus 13b
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
DeepMount00 Llama 3.1 Distilled
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
QW
MasterControlAIML Qwen2.5 7B Instruct 131K
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
MI
Minerva
Minerva · tensorblock
Params2.89B
Context16K
Smallest1.1 GB
SU
SuperNeuralDreadDevil 8b
Superneuraldreaddevil · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
KO
KoSOLAR 10.7B merge v3.4
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB