GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
GP
Rakeshkiriyath gpt2Medium_text_to_sql
Gpt · tensorblock
Params406M
Context1K
Smallest0.2 GB
AR
arcee lite
Arcee · tensorblock
Params1.78B
Context32K
Smallest0.8 GB
GR
Tesslate Gradience T1 3B Preview
Gradience · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
DI
DiscoLM_German_7b_v1
Discolm · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DA
H2O Danube 1.8b Sft
Danube · tensorblock
Params1.83B
Context16K
Smallest0.7 GB
LL
Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GE
Gemma 2 2b It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
LL
Llama 3 Galen 8B 32k v1
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
RW
SmerkyG Rwkv 6 World 3b
Rwkv · tensorblock
Params3.1B
Context1024K
Smallest1.2 GB
QR
Qra 13b
Qra · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Hermes 3 Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MI
Mistral 7B Base SFT SLiC HF
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Choco58 MistraMystic
Mistramystic · tensorblock
Params7.25B
Context32K
Smallest2.7 GB
ST
TechxGenus Starcoder2 3b Instruct
StarCoder · tensorblock
Params3.03B
Context16K
Smallest1.2 GB
OL
Allenai OLMo 7B 0724 Hf
OLMo · tensorblock
Params6.89B
Context4K
Smallest2.6 GB
ST
Cognitivecomputations Dolphincoder Starcoder2 15b
StarCoder · tensorblock
Params16B
Context16K
Smallest6.2 GB
LL
pub llama 13B v6
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
LL
ELYZA Japanese CodeLlama 7b Instruct
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
WE
Gair Prox Web Chunk Refining Lm
Web · tensorblock
Params354M
Context2K
Smallest0.1 GB
MI
FPHam Writing Partner Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DC
oh dcft v3 sharegpt format sedrick
Dcft · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GE
gemma ko 7b it v0.41
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
NO
Nox Solar 10.7b v2
Nox · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
AI
Airoboros L2 70b 3.1.2
Airoboros · tensorblock
Params69B
Context4K
Smallest25.5 GB
WI
wiro llm tr v0.1
Wiroai · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
MA
Anthracite Org Magnum v3 27b Kto
Magnum · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
NU
NuExtract tiny
Nuextract · tensorblock
Params464M
Context32K
Smallest0.2 GB
QW
calme 3.1 qwenloi 3b
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
VI
Vicuna Class Tutor 13b Ep3
Vicuna · tensorblock
Params13B
Context4K
Smallest4.9 GB