GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
H2Oai H2Ogpt 32k Codellama 34b Instruct
Llama · tensorblock
Params33.7B
Context32K
Smallest12.5 GB
Coding
LD
LDCC LDCC SOLAR 10.7B
Ldcc · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
MP
Mosaicml Mpt 7b Chat
Mpt · tensorblock
Params6.65B
Context2K
Smallest2.6 GB
GGUF
GE
gemma 7b openhermes v0.80
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
Tool use
DE
Mlx Community DeepSeek R1 0528 Qwen3 8B Bf16
DeepSeek · tensorblock
Params8.19B
Context128K
Smallest3.3 GB
Reasoning
FI
neural coder finetuned 5
Finetuned · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
CodingTool use
QW
Qwen2.5 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
QW
kamelcharaf GRPO qwen2.5 3B qwen2.5 3B mrd3 s7 sum token prompt merged
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
GGUF
WE
WestLake 7B v2
Westlake · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
UM
L3 Umbral Mind RP v3.0 8B
Umbral · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Roleplay
LL
Martyn Llama2 Megamerge Dare 13b v2
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
SO
T3Q ko solar dpo v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
HE
OEvortex HelpingAI Lite 2x1B
Helpingai · tensorblock
Params1.86B
Context2K
Smallest0.7 GB
Coding
TA
Yentinglin Taiwan LLM 7B v2.0 Chat
Taiwan · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
SO
SOLAR 10.7b ko Y24 v0.1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
ME
Shaleen123 MedicalEDI 14b EDI Base 4
Medicaledi · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
Tool use
MI
Mistral Small 24B Base 2501
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
GGUF
LL
Tamil Llama 7b Base v0.1
Llama · tensorblock
Params6.87B
Context4K
Smallest2.6 GB
GGUF
LL
Starmpcc Asclepius Llama2 13B
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
MI
Mistral 7B v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
FreedomIntelligence HuatuoGPT Vision 7B Qwen2.5VL
Qwen · tensorblock
Params7.62B
Context125K
Smallest3.0 GB
Tool useVision
MI
MiniCPM3 4B
MiniCPM · tensorblock
Params4.07B
Context32K
Smallest1.6 GB
Tool use
LL
JSL Med Sft Llama 3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
IR
Nitral AI Irixxed Magcap 12B Slerp
Irixxed · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
GGUF
DA
datagemma rag 27b it
Datagemma · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
GGUF
TI
TinyLlama 1.1B 32k Instruct
Tinyllama · tensorblock
Params1.1B
Context32K
Smallest0.4 GB
GGUF
BI
BioMistral 7B TIES
Biomistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
MI
Mistral
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
KA
Kakaocorp Kanana 1.5 2.1b Instruct 2505
Kanana · tensorblock
Params2.32B
Context32K
Smallest1.0 GB
Tool use
SM
SmolLlamix 8x101M
Smolllamix · tensorblock
Params399M
Context32K
Smallest0.2 GB
GGUF

Keep browsing