GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
M4 Ai TinyMistral 6x248M
Tinymistral · tensorblock
Params1B
Context32K
Smallest0.4 GB
Coding
LL
Hermes 3 Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
RoleplayTool use
LL
Meta Llama Llama Guard 3 1B
Llama · tensorblock
Params1.5B
Context128K
Smallest0.7 GB
GGUF
CO
CompassJudger 1 32B Instruct
Compassjudger · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
Tool use
HA
Half NSFW Noromaid 7b
Half · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
KingNish Qwen2.5 0.5b RBase
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
GGUF
QW
Qwen Qwen3 1.7B MLX Bf16
Qwen · tensorblock
Params1.72B
Context40K
Smallest0.8 GB
ReasoningTool use
GE
GEITje 7B
Geitje · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
BO
Yanolja Bookworm 10.7B v0.4 DPO
Bookworm · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
LU
Lumimaid v0.2 12B
Lumimaid · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
SH
Google Shieldgemma 9b
Shieldgemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
IN
Internlm Internlm2 Math Plus 1_8b
InternLM · tensorblock
Params1.89B
Context8K
Smallest0.8 GB
GGUF
GP
gpt2 conversational or qa
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
DA
H2O Danube3 4b Chat
Danube · tensorblock
Params3.96B
Context8K
Smallest1.5 GB
GGUF
GE
UCLA AGI Gemma 2 9B It SPPO Iter2
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
QU
Quasar-3.7
Quasar · tensorblock
Params7.62B
Context986K
Smallest3.0 GB
Tool use
NE
Nemo InstructContinuedFine
Nemo · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
Tool use
TI
Nickypro Tinyllama 15M
Tinyllama · tensorblock
Params15M
Context256
Smallest0.0 GB
GGUF
VI
Vinallama 2.7b Chat
Vinallama · tensorblock
Params2.77B
Context4K
Smallest1.1 GB
GGUF
LL
Aisingapore Llama SEA LION v2 8B IT
Llama · tensorblock
Params21M
Context8K
Smallest0.0 GB
GGUF
LL
Llama OpenReviewer 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
BL
bloom 3b conversational
Bloom · tensorblock
Params3.64B
Context3K
Smallest1.6 GB
Coding
LL
Meta Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
SE
Seallm 7b v2.5 v1
Seallm · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF
LL
llama2 tifa question generation
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Llama2 13b Dpo v4
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
RH
Rho 1b Sft MATH
Rho · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
QW
Alibaba NLP Gte Qwen2 1.5B Instruct
Qwen · tensorblock
Params1.78B
Context128K
Smallest0.8 GB
Embedding
CO
Colinglab ConcreteGPT 124M 128ctx Strict Small Mixed_Bins
Concretegpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF

Keep browsing