GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
TI
M4 Ai TinyMistral 6x248M
Tinymistral · tensorblock
Params1B
Context32K
Smallest0.4 GB
LL
Hermes 3 Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Meta Llama Llama Guard 3 1B
Llama · tensorblock
Params1.5B
Context128K
Smallest0.7 GB
CO
CompassJudger 1 32B Instruct
Compassjudger · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
HA
Half NSFW Noromaid 7b
Half · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
KingNish Qwen2.5 0.5b RBase
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
QW
Qwen Qwen3 1.7B MLX Bf16
Qwen · tensorblock
Params1.72B
Context40K
Smallest0.8 GB
GE
GEITje 7B
Geitje · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
BO
Yanolja Bookworm 10.7B v0.4 DPO
Bookworm · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
LU
Lumimaid v0.2 12B
Lumimaid · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
SH
Google Shieldgemma 9b
Shieldgemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
IN
Internlm Internlm2 Math Plus 1_8b
InternLM · tensorblock
Params1.89B
Context8K
Smallest0.8 GB
GP
gpt2 conversational or qa
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
DA
H2O Danube3 4b Chat
Danube · tensorblock
Params3.96B
Context8K
Smallest1.5 GB
GE
UCLA AGI Gemma 2 9B It SPPO Iter2
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
QU
Quasar-3.7
Quasar · tensorblock
Params7.62B
Context986K
Smallest3.0 GB
NE
Nemo InstructContinuedFine
Nemo · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
TI
Nickypro Tinyllama 15M
Tinyllama · tensorblock
Params15M
Context256
Smallest0.0 GB
VI
Vinallama 2.7b Chat
Vinallama · tensorblock
Params2.77B
Context4K
Smallest1.1 GB
LL
Aisingapore Llama SEA LION v2 8B IT
Llama · tensorblock
Params21M
Context8K
Smallest0.0 GB
LL
Llama OpenReviewer 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
BL
bloom 3b conversational
Bloom · tensorblock
Params3.64B
Context3K
Smallest1.6 GB
LL
Meta Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
SE
Seallm 7b v2.5 v1
Seallm · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
LL
llama2 tifa question generation
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
Llama2 13b Dpo v4
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
RH
Rho 1b Sft MATH
Rho · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
QW
Alibaba NLP Gte Qwen2 1.5B Instruct
Qwen · tensorblock
Params1.78B
Context128K
Smallest0.8 GB
CO
Colinglab ConcreteGPT 124M 128ctx Strict Small Mixed_Bins
Concretegpt · tensorblock
Params163M
Context1K
Smallest0.1 GB