GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
LLM4Binary Llm4Decompile 1.3b v1.5
Llm · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
GGUF
GR
Ibm Granite Granite 3.0 8b Instruct
Granite · tensorblock
Params8.17B
Context4K
Smallest3.1 GB
Tool use
SO
Kodonho Solar OrcaDPO Solar Instruct SLERP
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
DE
RTLCoder Deepseek v1.1
DeepSeek · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
Coding
GE
Huihui Ai Gemma 3 1b It Abliterated
Gemma · tensorblock
Params1B
Context32K
Smallest0.7 GB
GGUF
LL
LLM4Binary Llm4Decompile 22b v2
Llm · tensorblock
Params22.2B
Context32K
Smallest8.3 GB
GGUF
EX
LGAI EXAONE EXAONE Deep 7.8B
Exaone · tensorblock
Params7.82B
Context32K
Smallest3.1 GB
GGUF
LL
Arabic llama3.1 16bit FT
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
TheBloke CodeLlama 13B Instruct Fp16
Llama · tensorblock
Params13B
Context16K
Smallest4.9 GB
Coding
QW
Qwen2.5 7b Bnb 4bit
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
GGUF
YI
01 Ai Yi 1.5 6B Chat
Yi · tensorblock
Params6.06B
Context4K
Smallest2.3 GB
GGUF
ST
StableLM 2 1.6B Chat
Stablelm · tensorblock
Params1.64B
Context4K
Smallest0.7 GB
Tool use
GE
gemma 2B Full claude 1
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
PH
Phi 3 Mini 128k Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
Coding
TU
Allenai Tulu 2 Dpo 7b
Tulu · tensorblock
Params6.74B
Context8K
Smallest2.5 GB
GGUF
QL
Josephgflowers Qllama Tiny .5B Test 1
Qllama · tensorblock
Params464M
Context4K
Smallest0.2 GB
GGUF
LL
Llama 3.1 8B bonito v1
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LI
Linkbricks Horizon AI Korean Pro 12B
Linkbricks · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
Tool use
LL
Huihui Ai Llama 3.3 70B Instruct Abliterated
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
LU
Luxia 21.4b Alignment v1.0
Luxia · tensorblock
Params21.4B
Context32K
Smallest8.1 GB
GGUF
LL
Asap7772 Sft Prm800K Llama31 8b Steptok
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
LL
Alpindale Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
Coding
GE
Aisingapore Gemma2 9b Cpt Sea Lionv3 Instruct
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Roleplay
LL
SEOKDONG Llama3.1_Korean_V0.1_Sft_By_Aidx
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SM
Mlx Community SmolLM 360M Instruct
SmolLM · tensorblock
Params362M
Context2K
Smallest0.2 GB
Tool use
NO
Gwonny Nox Solar 10.7b v4 Kolon All 5 v3.0
Nox · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
DE
DeepSeek R1 Distill Llama 3B
DeepSeek · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Reasoning

Keep browsing