GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
YI
01 Ai Yi 9B
Yi · tensorblock
Params8.83B
Context4K
Smallest3.4 GB
GGUF
NX
NTQAI Nxcode CQ 7B Orpo
Nxcode · tensorblock
Params7.25B
Context64K
Smallest3.1 GB
Coding
CO
Google Codegemma 7b
Codegemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
Coding
HE
raicrits Hermes7b ITA
Hermes · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
Tool use
MI
MNCLLM Mistral 7B OP over1k grad1.0
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
CA
CarbonBeagle 11B
Carbonbeagle · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
PY
EleutherAI Pythia 1b Deduped
Pythia · tensorblock
Params1.01B
Context2K
Smallest0.4 GB
GGUF
LL
Llama 3 8b Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
NE
NeuralExperiment 7b MagicCoder v7
Neuralexperiment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
ME
IBI CAAI MELT TinyLlama 1.1B Chat v1.0
Melt · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
ZE
Uukuguy Zephyr 7b Alpha Dare 0.85
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SF
sft solar 10.7b v1
Sft · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
Abacusai Smaug Llama 3 70B Instruct 32K
Llama · tensorblock
Params70.6B
Context32K
Smallest26.4 GB
GGUF
QW
Qwen Qwen2.5 Coder 0.5B Instruct
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
CodingTool use
BG
INSAIT Institute BgGPT 7B Instruct v0.1
Bggpt · tensorblock
Params7.29B
Context32K
Smallest2.7 GB
GGUF
SA
Saul 7B Instruct v1
Saul · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
TE
TinyPixel testmodel 3
Testmodel · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
SA
Sail Sailor 0.5B Chat
Sailor · tensorblock
Params620M
Context32K
Smallest0.3 GB
GGUF
FA
Vilsonrodrigues Falcon 7b Instruct Sharded
Falcon · tensorblock
Params6.92B
Context2K
Smallest3.7 GB
GGUF
LL
Linly AI Chinese LLaMA 2 13B Hf
Llama · tensorblock
Params13.1B
Context2K
Smallest4.9 GB
GGUF
MI
MiniCPM 2B dpo fp32
MiniCPM · tensorblock
Params2.72B
Context4K
Smallest1.2 GB
GGUF
QW
Qwen2.5 3B
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
GGUF
YA
Yasmine777 Nn
tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
DE
Deepseek Ai Deepseek Coder 6.7b Instruct
DeepSeek · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
ME
Llemma_7B
Metamath · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
FA
Tiiuae Falcon 7b
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
GGUF
CH
Chocolatine 2 14B Instruct v2.0b3
Chocolatine · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
Tool use
ZE
Royallab ZephRP M7B
Zephrp · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
HK
hkcode solar 10.7b
Hkcode · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
RO
RoMistral 7b Instruct 2024 05 17
Romistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF

Keep browsing