GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Llama 3.2 1B Instruct
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
LL
Llama Traditional Chinese 120M
Llama · tensorblock
Params120M
Context2K
Smallest0.1 GB
SO
T3Q ko solar sft v3.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
MI
KoboldAI Mistral 7B Holodeck 1
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
Qwen2.5 3B Instruct
Qwen · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
LL
Uukuguy Speechless Codellama 34b v1.9
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
LE
LDCC SOLAR 10.7B
Leaderboard · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
LL
SentientAGI Dobby Unhinged Llama 3.3 70B
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
KA
Kakaocorp Kanana 1.5 15.7b A3B Instruct
Kanana · tensorblock
Params15.7B
Context32K
Smallest6.5 GB
CO
COKAL DPO test v2 13b
Cokal · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
LL
Komodo Llama 3.2 3B v2 fp16
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
LL
llama 3 8b English to Hinglish
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
CU
PracticeLLM Custom KoLLM 13B v5
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
MI
Malhajar Mistral 7B Instruct v0.2 Turkish
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GE
Google Gemma 1.1 7b It
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
LL
Llama 3.2 1B Instruct
Llama · tensorblock
Params1.5B
Context128K
Smallest0.7 GB
AR
Arch Function 3B
Arch · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
MI
Norquinal Mistral 7B claude chat
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
T3Q LLM Solar10.8 Sft v1.0
Llm · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
VI
prithivMLmods Viper Coder HybridMini v1.3
Viper · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
LL
llama3 eng ko 8b sl6 1
Llama · tensorblock
Params8.2B
Context8K
Smallest3.3 GB
KO
KBNIT KoSOLAR 10.7B QLoRA NEFTune Kolon v0.1
Kosolar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
CA
CarbonBeagle 11B
Carbonbeagle · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
QW
Qwen QVQ 72B Preview
Qwen · tensorblock
Params72.7B
Context125K
Smallest29.8 GB
ST
Tiny_Starcoder_Py
StarCoder · tensorblock
Params—
Context8K
Smallest0.0 GB
LL
Suzume Llama 3 8B Multilingual
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
UN
fblgit una cybertron 7b v1 fp16
Una · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
DO
Maestro v3 DPO 13b
Dopeornope · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
MI
MiaLatte Indo Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
LLAMA 2 13b Ko Y24 DPO_v2.1
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB