GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
AU
saishf Aura Uncensored OAS 8B L3
Aura · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OC
PleIAs OCRonos Vintage
Ocronos · tensorblock
Params163M
Context1K
Smallest0.1 GB
LL
CodeLlama 7b Python Hf
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
SA
Sakura SOLAR
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
llama3 pre1 pre2 ds lora3
Llama · tensorblock
Params8.2B
Context8K
Smallest3.3 GB
MI
Mistral 7B Instruct DPO
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SH
Google Shieldgemma 2b
Shieldgemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
LL
Llama3 70B Fireplace
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
MA
Math_Gpt2
Math · tensorblock
Params163M
Context1K
Smallest0.1 GB
LL
Meta Llama Llama Guard 3 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
llama2 13b v1
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
QW
II Tulu 3B SFT
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
LL
Ja Ck Llama 2 13b DPO Y24 v2
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
DE
prithivMLmods Qwen2.5 1.5B DeepSeek R1 Instruct
DeepSeek · tensorblock
Params1.78B
Context32K
Smallest0.8 GB
SF
sft solar 10.7b v1.1
Sft · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
AY
CohereForAI Aya 23 35B
Aya · tensorblock
Params35B
Context8K
Smallest13.8 GB
LL
Llama 2 13b Hf
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
MA
Magicoder S DS 6.7B
Magicoder · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
LL
KONIexp V3_1_Pt_Ep1_Sft_5_Based_On_Llama3_1_8B_Final_Data_20241019
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
CO
Merged
Cokal · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GE
Rinna Gemma 2 Baku 2b It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
MA
mamba gpt 3b v4
Mamba · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
LL
NCSOFT Llama 3 OffsetBias 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Mixtralmerge 8x7B Rebalanced Test
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
QW
Xinlai Qwen2 7B Instruct Step DPO
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
OR
We Want GPU Yi Ko 6B Orca Alpaca Gpt4 Math Lora DPO
Orca · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
PY
mnoukhov pythia2.8b sft tldr
Pythia · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
MI
MNCJihunKim Mistral 7B SlimOrca OP 8k
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
reflect_qwen3Bb_80kSftT2_Om2G8kOm2AgG8k40kIpsdpT02
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
MI
Felladrin Minueza 2 96M
Minueza · tensorblock
Params96M
Context4K
Smallest0.1 GB