GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GP
Rakeshkiriyath gpt2Medium_text_to_sql
Gpt · tensorblock
Params406M
Context1K
Smallest0.2 GB
GGUF
AR
arcee lite
Arcee · tensorblock
Params1.78B
Context32K
Smallest0.8 GB
GGUF
GR
Tesslate Gradience T1 3B Preview
Gradience · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
ReasoningTool use
DI
DiscoLM_German_7b_v1
Discolm · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DA
H2O Danube 1.8b Sft
Danube · tensorblock
Params1.83B
Context16K
Smallest0.7 GB
GGUF
LL
Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GGUF
GE
Gemma 2 2b It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
LL
Llama 3 Galen 8B 32k v1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GGUF
RW
SmerkyG Rwkv 6 World 3b
Rwkv · tensorblock
Params3.1B
Context1024K
Smallest1.2 GB
GGUF
QR
Qra 13b
Qra · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
MI
Mistral 7B Base SFT SLiC HF
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Choco58 MistraMystic
Mistramystic · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
GGUF
ST
TechxGenus Starcoder2 3b Instruct
StarCoder · tensorblock
Params3.03B
Context16K
Smallest1.2 GB
Coding
OL
Allenai OLMo 7B 0724 Hf
OLMo · tensorblock
Params6.89B
Context4K
Smallest2.6 GB
GGUF
ST
Cognitivecomputations Dolphincoder Starcoder2 15b
StarCoder · tensorblock
Params16B
Context16K
Smallest6.2 GB
CodingTool use
LL
pub llama 13B v6
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
LL
ELYZA Japanese CodeLlama 7b Instruct
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
WE
Gair Prox Web Chunk Refining Lm
Web · tensorblock
Params354M
Context2K
Smallest0.1 GB
Coding
MI
FPHam Writing Partner Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DC
oh dcft v3 sharegpt format sedrick
Dcft · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
GE
gemma ko 7b it v0.41
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF
NO
Nox Solar 10.7b v2
Nox · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
AI
Airoboros L2 70b 3.1.2
Airoboros · tensorblock
Params69B
Context4K
Smallest25.5 GB
GGUF
WI
wiro llm tr v0.1
Wiroai · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
MA
Anthracite Org Magnum v3 27b Kto
Magnum · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
GGUF
NU
NuExtract tiny
Nuextract · tensorblock
Params464M
Context32K
Smallest0.2 GB
GGUF
QW
calme 3.1 qwenloi 3b
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
VI
Vicuna Class Tutor 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF

Keep browsing