GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AU
saishf Aura Uncensored OAS 8B L3
Aura · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OC
PleIAs OCRonos Vintage
Ocronos · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
LL
CodeLlama 7b Python Hf
Llama · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
SA
Sakura SOLAR
Sakura · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
llama3 pre1 pre2 ds lora3
Llama · tensorblock
Params8.2B
Context8K
Smallest3.3 GB
GGUF
MI
Mistral 7B Instruct DPO
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SH
Google Shieldgemma 2b
Shieldgemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
LL
Llama3 70B Fireplace
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
Tool use
MA
Math_Gpt2
Math · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
LL
Meta Llama Llama Guard 3 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
llama2 13b v1
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
QW
II Tulu 3B SFT
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
LL
Ja Ck Llama 2 13b DPO Y24 v2
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
DE
prithivMLmods Qwen2.5 1.5B DeepSeek R1 Instruct
DeepSeek · tensorblock
Params1.78B
Context32K
Smallest0.8 GB
ReasoningTool use
SF
sft solar 10.7b v1.1
Sft · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
AY
CohereForAI Aya 23 35B
Aya · tensorblock
Params35B
Context8K
Smallest13.8 GB
GGUF
LL
Llama 2 13b Hf
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
MA
Magicoder S DS 6.7B
Magicoder · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
LL
KONIexp V3_1_Pt_Ep1_Sft_5_Based_On_Llama3_1_8B_Final_Data_20241019
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
CO
Merged
Cokal · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
GE
Rinna Gemma 2 Baku 2b It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
MA
mamba gpt 3b v4
Mamba · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
GGUF
LL
NCSOFT Llama 3 OffsetBias 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
Mixtralmerge 8x7B Rebalanced Test
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
QW
Xinlai Qwen2 7B Instruct Step DPO
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
GGUF
OR
We Want GPU Yi Ko 6B Orca Alpaca Gpt4 Math Lora DPO
Orca · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
PY
mnoukhov pythia2.8b sft tldr
Pythia · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
MI
MNCJihunKim Mistral 7B SlimOrca OP 8k
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
reflect_qwen3Bb_80kSftT2_Om2G8kOm2AgG8k40kIpsdpT02
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
MI
Felladrin Minueza 2 96M
Minueza · tensorblock
Params96M
Context4K
Smallest0.1 GB
GGUF

Keep browsing