GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
Jrahn gpt3_125M_edu_hermes
Gpt · tensorblock
Params164M
Context2K
Smallest0.1 GB
Tool use
AL
AlphaMonarch 7B
Alphamonarch · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
TE
openGPT X Teuken 7B Instruct Research v0.4
Teuken · tensorblock
Params7.45B
Context4K
Smallest3.4 GB
GGUF
UN
Ajibawa 2023 Uncensored Jordan 7B
Uncensored · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
LL
42MARU GenAI Llama2 Ko En Dpo 13b v2
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
GH
Ghost 8b Beta 1608
Ghost · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Tool use
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MI
TitanML Tiny Mixtral
Mistral · tensorblock
Params247M
Context128K
Smallest0.1 GB
GGUF
L5
L500MT
tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
PL
Platypus2 7B
Platypus · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MI
Mistral solar slerp
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
CO
01 Ai Yi Coder 9B Chat
Coder · tensorblock
Params8.83B
Context128K
Smallest3.4 GB
Coding
LL
LLaMA 3 8B Instruct TR DPO
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SA
Kyujinpy Sakura SOLRCA Math Instruct DPO v1
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
SI
SILMA Kashif 2B Instruct v1.0
Silma · tensorblock
Params2.61B
Context12K
Smallest1.2 GB
GGUF
MI
Mistral Nemo Base 2407
Mistral · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
LL
Zhengyi LLaMA Mesh
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
IN
Internlm Internlm2 Chat 7b Sft
InternLM · tensorblock
Params7.74B
Context32K
Smallest3.0 GB
GGUF
IN
Instruction Pretrain InstructLM 500M
Instructlm · tensorblock
Params568M
Context2K
Smallest0.2 GB
GGUF
MY
Mythalion 13b
Mythalion · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
MI
Cognitivecomputations Dolphin 2.6 Mistral 7b Dpo
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CodingTool use
LL
Llama-3-8B-Instruct-v0.9
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SO
Megastudyedu M SOLAR 10.7B v1.3 Dpo
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
ME
prithivMLmods Megatron Opus 14B 2.1
Megatron · tensorblock
Params14.7B
Context16K
Smallest5.6 GB
GGUF
LL
Uukuguy Speechless Llama2 Hermes Orca Platypus 13b
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
Tool use
LL
DeepMount00 Llama 3.1 Distilled
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
QW
MasterControlAIML Qwen2.5 7B Instruct 131K
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
MI
Minerva
Minerva · tensorblock
Params2.89B
Context16K
Smallest1.1 GB
GGUF
SU
SuperNeuralDreadDevil 8b
Superneuraldreaddevil · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
KO
KoSOLAR 10.7B merge v3.4
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF

Keep browsing