GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
COLA3 7B
Cola · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
ME
mera mix 4x7B
Mera · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
GGUF
TI
TinyLlama TinyLlama 1.1B Chat v0.4
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
MI
Mistral 7B Instruct IPO
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
AL
ALMA 13B R
Alma · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
GE
Luel Gemma 3 4b Tigrinya
Gemma · tensorblock
Params3.88B
Context128K
Smallest1.7 GB
GGUF
SH
Shisa Gamma 7b v1
Shisa · tensorblock
Params7.24B
Context4K
Smallest2.7 GB
GGUF
TI
Tiny Mpt Random Remote Code
Tiny · tensorblock
Params7M
Context2K
Smallest0.0 GB
Coding
ST
tiny random starcoder2
StarCoder · tensorblock
Params123M
Context16K
Smallest0.1 GB
Coding
MI
synapsellm 7b mistral v0.3 preview
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
FL
FluentlyLM Prinum
Fluentlyqwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
CodingReasoningRoleplay
SE
SecurityLLM
Securityllm · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
NE
Nvidia AceReason Nemotron 7B
Nemotron · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
CodingReasoningTool use
OR
Sosoai Orion 14B Chat RAG Safetensors
Orion · tensorblock
Params14.5B
Context4K
Smallest5.5 GB
Coding
LL
Swap Uniba LLaMAntino 2 7b Hf ITA
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
Tokyotech Llm Llama 3.1 Swallow 8B Instruct v0.5
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
DE
DeepSeek R1 Qwen2.5 1.5b SFT R1 JSON Unstructured To Structured
DeepSeek · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
ReasoningTool use
QW
Qwen2.5 32B
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
Roleplay
MA
State Spaces Mamba 130m Hf
Mamba · tensorblock
Params129M
Context1024K
Smallest0.1 GB
GGUF
MI
ZeroAgency Mistral Small 3.1 24B Instruct 2503 Hf
Mistral · tensorblock
Params23.6B
Context128K
Smallest8.9 GB
GGUF
LL
Llama 3 Instruction Constructionsafety
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
llama 3.1 Asian Bllossom 8B Translator
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
PH
phi 1 5
Phi · tensorblock
Params1.42B
Context2K
Smallest0.6 GB
Coding
GP
Openai Community Gpt2 Large
Gpt · tensorblock
Params838M
Context1K
Smallest0.3 GB
GGUF
LL
WhiteRabbitNeo Llama 3 WhiteRabbitNeo 8B v2.0
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
AL
ALLaM AI ALLaM 7B Instruct Preview
Allam · tensorblock
Params7B
Context4K
Smallest2.7 GB
GGUF
LL
Sparse Llama 3.1 8B 2of4
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Nvidia Llama 3_1 Nemotron 51B Instruct
Llama · tensorblock
Params51.5B
Context128K
Smallest19.4 GB
Tool use
LL
Hermes 3 Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
EE
eeve dpo v3
Eeve · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF

Keep browsing