GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
llama3_KM
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
KY
Kyujinpy PlatYi 34B 200k Q FastChat
Kyujinpy · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
PH
Phi 3.5 mini ITA
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
PO
POLAR 14B v0.5
Polar · tensorblock
Params14.2B
Context4K
Smallest5.3 GB
SO
Changgil K2S3 SOLAR 11b v1.0
Solar · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
QW
Qwen2 7B Multilingual RP
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
CU
Custom KoLLM 13B v2
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
CH
ChatTime 1 7B Base
Chattime · tensorblock
Params6.82B
Context4K
Smallest2.6 GB
LL
LLaMA2_crosslingual_transfer_1
Llama · tensorblock
Params6.86B
Context4K
Smallest2.6 GB
LL
Instruction Pretrain Finance Llama3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
hlo world dolphin 2.1 mistral 7b tgi
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
MergeBench Llama 8B It Llama 3.1 8b It_Aya_2Epoch
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
QW
Qwen2.5 32B
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
AR
Arch Function 1.5B
Arch · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
LL
Mlabonne Hermes 3 Llama 3.1 8B Lorablated
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
QW
AiCloser Qwen2.5 32B AGI
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
RI
Rizla 17b
Rizla · tensorblock
Params15.6B
Context32K
Smallest5.8 GB
ME
Metharme 7b
Metharme · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
ME
Adarshkumardalai Mental Health Chatbot
Mental · tensorblock
Params82M
Context1K
Smallest0.1 GB
MA
Magic Dolphin 7b
Magic · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
MO
model 6hs
Model · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Fireball Alpaca Llama3.1.07 8B Philos Math
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
SH
Shallow6414 Sn11 3 5 1
Shallow · tensorblock
Params27B
Context128K
Smallest10.5 GB
MI
agg shambhavi MimicLlama 3.1 8B DPO
Mimicllama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
YA
Yarn Solar 10b 32k
Yarn · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
KO
realPCH kosolra_SFT_DPO_v0
Kosolra · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
DP
Albertfares DPO_MCQA_model
Dpo · tensorblock
Params752M
Context32K
Smallest0.3 GB
QW
Eternis eternis_anonymizer_merge_Qwen3 0.6B_9jul_30k
Qwen · tensorblock
Params596M
Context40K
Smallest0.3 GB
SW
NovaSky AI SWE Gym OpenHands 7B Agent
Swe · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
LL
Llama_2_13B
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB