GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
llama3 eng ko 8b sl3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GE
Google Gemma 3 1b It
Gemma · tensorblock
Params1B
Context32K
Smallest0.7 GB
TI
AliMaatouk TinyLlama 1.1B Tele
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
BA
Bagel Dpo 7b v0.1
Bagel · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
YI
01 Ai Yi 34B Chat
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
RA
Bloom 560m
Rankinggpt · tensorblock
Params816M
Context1K
Smallest0.4 GB
QW
Qwen2.5 1.5B
Qwen · tensorblock
Params1.54B
Context128K
Smallest0.7 GB
QW
Qwen Qwen2.5 Coder 14B Instruct
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
DU
Ashikan Dut Recipe Generator
Dut · tensorblock
Params816M
Context1K
Smallest0.4 GB
LL
Llama 3 KoEn 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
QW
Qwen Qwen2.5 Coder 3B Instruct
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
PH
Phi 3.5 MoE Instruct
Phi · tensorblock
Params41.9B
Context128K
Smallest15.3 GB
YI
Brucethemoose Yi 34B 200K DARE Megamerge v8
Yi · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
ME
Ilsp Meltemi 7B Instruct v1.5
Meltemi · tensorblock
Params7.48B
Context32K
Smallest2.9 GB
LL
Vikhr-Llama-3.2-1B-instruct
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
DE
Deepseek Ai Deepseek Coder 33b Base
DeepSeek · tensorblock
Params33.3B
Context16K
Smallest12.4 GB
GE
Google Gemma 2 2b It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
DA
Danube Ko 1.8b Base
Danube · tensorblock
Params1.87B
Context2K
Smallest0.7 GB
MI
mistral 7b grok
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GE
Google Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
LL
DeepHermes 3 Llama 3 8B Preview
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama3 OpenBioLLM 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
QW
Mlx Community QwQ 32B Bf16
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
NU
NuminaMath 7B TIR
Numinamath · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
GR
Ibm Granite Granite 3.0 2b Base
Granite · tensorblock
Params2.53B
Context4K
Smallest1.0 GB
TI
TinyMistral 248M v2.5
Tinymistral · tensorblock
Params248M
Context32K
Smallest0.1 GB
AY
CohereForAI Aya Expanse 8b
Aya · tensorblock
Params8.03B
Context8K
Smallest3.4 GB
LL
Llama 3.1 8B MultiReflection Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LA
Ricdomolm Lawma 8b
Lawma · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
PL
Kyujinpy Ko PlatYi 6B Kiwi
Platyi · tensorblock
Params6.18B
Context2K
Smallest2.4 GB