GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama3 eng ko 8b sl3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GE
Google Gemma 3 1b It
Gemma · tensorblock
Params1B
Context32K
Smallest0.7 GB
GGUF
TI
AliMaatouk TinyLlama 1.1B Tele
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
BA
Bagel Dpo 7b v0.1
Bagel · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
YI
01 Ai Yi 34B Chat
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
RA
Bloom 560m
Rankinggpt · tensorblock
Params816M
Context1K
Smallest0.4 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · tensorblock
Params1.54B
Context128K
Smallest0.7 GB
GGUF
QW
Qwen Qwen2.5 Coder 14B Instruct
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
CodingTool use
DU
Ashikan Dut Recipe Generator
Dut · tensorblock
Params816M
Context1K
Smallest0.4 GB
GGUF
LL
Llama 3 KoEn 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
QW
Qwen Qwen2.5 Coder 3B Instruct
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
CodingTool use
PH
Phi 3.5 MoE Instruct
Phi · tensorblock
Params41.9B
Context128K
Smallest15.3 GB
Coding
YI
Brucethemoose Yi 34B 200K DARE Megamerge v8
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
ME
Ilsp Meltemi 7B Instruct v1.5
Meltemi · tensorblock
Params7.48B
Context32K
Smallest2.9 GB
GGUF
LL
Vikhr-Llama-3.2-1B-instruct
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
Tool use
DE
Deepseek Ai Deepseek Coder 33b Base
DeepSeek · tensorblock
Params33.3B
Context16K
Smallest12.4 GB
Coding
GE
Google Gemma 2 2b It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
DA
Danube Ko 1.8b Base
Danube · tensorblock
Params1.87B
Context2K
Smallest0.7 GB
GGUF
MI
mistral 7b grok
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
GE
Google Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
LL
DeepHermes 3 Llama 3 8B Preview
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ReasoningRoleplayTool use
LL
Llama3 OpenBioLLM 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
QW
Mlx Community QwQ 32B Bf16
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
NU
NuminaMath 7B TIR
Numinamath · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
GGUF
GR
Ibm Granite Granite 3.0 2b Base
Granite · tensorblock
Params2.53B
Context4K
Smallest1.0 GB
GGUF
TI
TinyMistral 248M v2.5
Tinymistral · tensorblock
Params248M
Context32K
Smallest0.1 GB
Coding
AY
CohereForAI Aya Expanse 8b
Aya · tensorblock
Params8.03B
Context8K
Smallest3.4 GB
GGUF
LL
Llama 3.1 8B MultiReflection Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LA
Ricdomolm Lawma 8b
Lawma · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
PL
Kyujinpy Ko PlatYi 6B Kiwi
Platyi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF

Keep browsing