GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
H2Oai H2Ogpt 32k Codellama 34b Instruct
Llama · tensorblock
Params33.7B
Context32K
Smallest12.5 GB
LD
LDCC LDCC SOLAR 10.7B
Ldcc · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
MP
Mosaicml Mpt 7b Chat
Mpt · tensorblock
Params6.65B
Context2K
Smallest2.6 GB
GE
gemma 7b openhermes v0.80
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
DE
Mlx Community DeepSeek R1 0528 Qwen3 8B Bf16
DeepSeek · tensorblock
Params8.19B
Context128K
Smallest3.3 GB
FI
neural coder finetuned 5
Finetuned · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
QW
Qwen2.5 7B Instruct
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
QW
kamelcharaf GRPO qwen2.5 3B qwen2.5 3B mrd3 s7 sum token prompt merged
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
WE
WestLake 7B v2
Westlake · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
UM
L3 Umbral Mind RP v3.0 8B
Umbral · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Martyn Llama2 Megamerge Dare 13b v2
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
SO
T3Q ko solar dpo v1.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
HE
OEvortex HelpingAI Lite 2x1B
Helpingai · tensorblock
Params1.86B
Context2K
Smallest0.7 GB
TA
Yentinglin Taiwan LLM 7B v2.0 Chat
Taiwan · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
SO
SOLAR 10.7b ko Y24 v0.1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
ME
Shaleen123 MedicalEDI 14b EDI Base 4
Medicaledi · tensorblock
Params14.8B
Context128K
Smallest5.8 GB
MI
Mistral Small 24B Base 2501
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
LL
Tamil Llama 7b Base v0.1
Llama · tensorblock
Params6.87B
Context4K
Smallest2.6 GB
LL
Starmpcc Asclepius Llama2 13B
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
MI
Mistral 7B v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
FreedomIntelligence HuatuoGPT Vision 7B Qwen2.5VL
Qwen · tensorblock
Params7.62B
Context125K
Smallest3.0 GB
MI
MiniCPM3 4B
MiniCPM · tensorblock
Params4.07B
Context32K
Smallest1.6 GB
LL
JSL Med Sft Llama 3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
IR
Nitral AI Irixxed Magcap 12B Slerp
Irixxed · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
DA
datagemma rag 27b it
Datagemma · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
TI
TinyLlama 1.1B 32k Instruct
Tinyllama · tensorblock
Params1.1B
Context32K
Smallest0.4 GB
BI
BioMistral 7B TIES
Biomistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MI
Mistral
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
KA
Kakaocorp Kanana 1.5 2.1b Instruct 2505
Kanana · tensorblock
Params2.32B
Context32K
Smallest1.0 GB
SM
SmolLlamix 8x101M
Smolllamix · tensorblock
Params399M
Context32K
Smallest0.2 GB