GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 1B Instruct
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
Tool use
LL
Llama Traditional Chinese 120M
Llama · tensorblock
Params120M
Context2K
Smallest0.1 GB
GGUF
SO
T3Q ko solar sft v3.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
MI
KoboldAI Mistral 7B Holodeck 1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
LL
Uukuguy Speechless Codellama 34b v1.9
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
LE
LDCC SOLAR 10.7B
Leaderboard · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
Tool use
LL
SentientAGI Dobby Unhinged Llama 3.3 70B
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
RoleplayTool use
KA
Kakaocorp Kanana 1.5 15.7b A3B Instruct
Kanana · tensorblock
Params15.7B
Context32K
Smallest6.5 GB
Tool use
CO
COKAL DPO test v2 13b
Cokal · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
LL
Komodo Llama 3.2 3B v2 fp16
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
LL
llama 3 8b English to Hinglish
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
CU
PracticeLLM Custom KoLLM 13B v5
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
MI
Malhajar Mistral 7B Instruct v0.2 Turkish
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
GE
Google Gemma 1.1 7b It
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · tensorblock
Params1.5B
Context128K
Smallest0.7 GB
Tool use
AR
Arch Function 3B
Arch · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
Tool use
MI
Norquinal Mistral 7B claude chat
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
T3Q LLM Solar10.8 Sft v1.0
Llm · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
VI
prithivMLmods Viper Coder HybridMini v1.3
Viper · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
CodingTool use
LL
llama3 eng ko 8b sl6 1
Llama · tensorblock
Params8.2B
Context8K
Smallest3.3 GB
GGUF
KO
KBNIT KoSOLAR 10.7B QLoRA NEFTune Kolon v0.1
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
CA
CarbonBeagle 11B
Carbonbeagle · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
QW
Qwen QVQ 72B Preview
Qwen · tensorblock
Params72.7B
Context125K
Smallest29.8 GB
Vision
ST
Tiny_Starcoder_Py
StarCoder · tensorblock
Params—
Context8K
Smallest0.0 GB
Coding
LL
Suzume Llama 3 8B Multilingual
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
UN
fblgit una cybertron 7b v1 fp16
Una · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
DO
Maestro v3 DPO 13b
Dopeornope · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
MI
MiaLatte Indo Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
LLAMA 2 13b Ko Y24 DPO_v2.1
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF

Keep browsing