GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral 7B Base SFT CPO
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
GP
gpt2 124m fresh
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
MI
MetaMath NeuralHermes 2.5 Mistral 7B Linear
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
LL
Open_Llama_3B_V2
Llama · tensorblock
Params3.43B
Context2K
Smallest2.0 GB
GGUF
PO
Potato 3B
Potato · tensorblock
Params3.02B
Context4K
Smallest1.2 GB
GGUF
ST
stackexchange graphicdesign
Stackexchange · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
OhCherryFire Llama2 7b Gsm8K Policy Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
YU
YuE s1 7B anneal en cot
Yue · tensorblock
Params6.22B
Context16K
Smallest2.4 GB
GGUF
MI
Nilq Mistral 1L Tiny
Mistral · tensorblock
Params35M
Context2K
Smallest0.0 GB
GGUF
LL
Llama 3.1 SuperSwallow 70B Instruct v0.1
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
GGUF
ZE
Zephyr 7b Sft Full SPIN Iter0
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Weyaxi SlimOpenOrca Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
TE
Weyaxi Test Help Steer Filtered Orig
Test · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
PY
EleutherAI Pythia 1b
Pythia · tensorblock
Params1.01B
Context2K
Smallest0.4 GB
GGUF
GE
Google Gemma 2 2b Jpn It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
NI
NinjaDolphin 7B
Ninjadolphin · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Tool use
QW
Qwen2.5-1.5B-s1k-1.1
Qwen · tensorblock
Params1.78B
Context32K
Smallest0.8 GB
Tool use
GP
Qiyinmiss My_GPT2
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
DE
Delexa Instruct V0.1 7b
Delexa · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
PO
POLAR 14B 4.3 very big sft
Polar · tensorblock
Params14.2B
Context4K
Smallest5.3 GB
GGUF
MA
Kaitchup Mayonnaise 4in1 03
Mayonnaise · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Pongsaky Llama3.2 Typhoon2 1b Instruct Klon8 Llama_Factory
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
Tool use
SH
ShortKing 1.4b v0.1
Shortking · tensorblock
Params1.41B
Context2K
Smallest0.6 GB
GGUF
QW
Dnotitia Smoothie Qwen3 30B A3B
Qwen · tensorblock
Params30.5B
Context40K
Smallest11.3 GB
ReasoningTool use
QW
prithivMLmods Sombrero QwQ 32B Elite11
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
PO
0.5B-policy-iteration_1
Policy · tensorblock
Params494M
Context32K
Smallest0.3 GB
Tool use
QW
cutelemonlili Qwen 7B base ob 10k
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
LL
Llama 3 Base 8B SFT ORPO
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
QW
mlfoundations dev openthoughts3 full qwen25 1b
Qwen · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
MI
Featherless Chat Models Mistral 7B Instruct v0.2
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF

Keep browsing