GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
YI
01 Ai Yi 9B
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
NX
NTQAI Nxcode CQ 7B Orpo
Nxcode · tensorblock
Params7.25B
Context64K
Smallest3.1 GB
CO
Google Codegemma 7b
Codegemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
HE
raicrits Hermes7b ITA
Hermes · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MI
MNCLLM Mistral 7B OP over1k grad1.0
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CA
CarbonBeagle 11B
Carbonbeagle · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
PY
EleutherAI Pythia 1b Deduped
Pythia · tensorblock
Params1.01B
Context2K
Smallest0.4 GB
LL
Llama 3 8b Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
NE
NeuralExperiment 7b MagicCoder v7
Neuralexperiment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ME
IBI CAAI MELT TinyLlama 1.1B Chat v1.0
Melt · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
ZE
Uukuguy Zephyr 7b Alpha Dare 0.85
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SF
sft solar 10.7b v1
Sft · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
Abacusai Smaug Llama 3 70B Instruct 32K
Llama · tensorblock
Params70.6B
Context32K
Smallest26.4 GB
QW
Qwen Qwen2.5 Coder 0.5B Instruct
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
BG
INSAIT Institute BgGPT 7B Instruct v0.1
Bggpt · tensorblock
Params7.29B
Context32K
Smallest2.7 GB
SA
Saul 7B Instruct v1
Saul · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
TE
TinyPixel testmodel 3
Testmodel · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
SA
Sail Sailor 0.5B Chat
Sailor · tensorblock
Params620M
Context32K
Smallest0.3 GB
FA
Vilsonrodrigues Falcon 7b Instruct Sharded
Falcon · tensorblock
Params6.92B
Context2K
Smallest3.7 GB
LL
Linly AI Chinese LLaMA 2 13B Hf
Llama · tensorblock
Params13.1B
Context2K
Smallest4.9 GB
MI
MiniCPM 2B dpo fp32
MiniCPM · tensorblock
Params2.72B
Context4K
Smallest1.2 GB
QW
Qwen2.5 3B
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
YA
Yasmine777 Nn
tensorblock
Params8.03B
Context128K
Smallest3.2 GB
DE
Deepseek Ai Deepseek Coder 6.7b Instruct
DeepSeek · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
ME
Llemma_7B
Metamath · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
FA
Tiiuae Falcon 7b
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
CH
Chocolatine 2 14B Instruct v2.0b3
Chocolatine · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
ZE
Royallab ZephRP M7B
Zephrp · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
HK
hkcode solar 10.7b
Hkcode · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
RO
RoMistral 7b Instruct 2024 05 17
Romistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB