GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
LLM4Binary Llm4Decompile 1.3b v1.5
Llm · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
GR
Ibm Granite Granite 3.0 8b Instruct
Granite · tensorblock
Params8.17B
Context4K
Smallest3.1 GB
SO
Kodonho Solar OrcaDPO Solar Instruct SLERP
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
DE
RTLCoder Deepseek v1.1
DeepSeek · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
GE
Huihui Ai Gemma 3 1b It Abliterated
Gemma · tensorblock
Params1B
Context32K
Smallest0.7 GB
LL
LLM4Binary Llm4Decompile 22b v2
Llm · tensorblock
Params22.2B
Context32K
Smallest8.3 GB
EX
LGAI EXAONE EXAONE Deep 7.8B
Exaone · tensorblock
Params7.82B
Context32K
Smallest3.1 GB
LL
Arabic llama3.1 16bit FT
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
TheBloke CodeLlama 13B Instruct Fp16
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
QW
Qwen2.5 7b Bnb 4bit
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
YI
01 Ai Yi 1.5 6B Chat
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
ST
StableLM 2 1.6B Chat
Stablelm · tensorblock
Params1.64B
Context4K
Smallest0.7 GB
GE
gemma 2B Full claude 1
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
PH
Phi 3 Mini 128k Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
TU
Allenai Tulu 2 Dpo 7b
Tulu · tensorblock
Params6.74B
Context8K
Smallest2.5 GB
QL
Josephgflowers Qllama Tiny .5B Test 1
Qllama · tensorblock
Params464M
Context4K
Smallest0.2 GB
LL
Llama 3.1 8B bonito v1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LI
Linkbricks Horizon AI Korean Pro 12B
Linkbricks · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
LL
Huihui Ai Llama 3.3 70B Instruct Abliterated
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
LU
Luxia 21.4b Alignment v1.0
Luxia · tensorblock
Params21.4B
Context32K
Smallest8.1 GB
LL
Asap7772 Sft Prm800K Llama31 8b Steptok
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
LL
Alpindale Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
PH
Phi 3.5 Mini Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GE
Aisingapore Gemma2 9b Cpt Sea Lionv3 Instruct
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
MI
Mistral 7B Instruct v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
SEOKDONG Llama3.1_Korean_V0.1_Sft_By_Aidx
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SM
Mlx Community SmolLM 360M Instruct
SmolLM · tensorblock
Params362M
Context2K
Smallest0.2 GB
NO
Gwonny Nox Solar 10.7b v4 Kolon All 5 v3.0
Nox · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
DE
DeepSeek R1 Distill Llama 3B
DeepSeek · tensorblock
Params3.21B
Context128K
Smallest1.4 GB