GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llama3_KM
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
KY
Kyujinpy PlatYi 34B 200k Q FastChat
Kyujinpy · tensorblock
Params34.4B
Context195K
Smallest12.8 GB
GGUF
PH
Phi 3.5 mini ITA
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
PO
POLAR 14B v0.5
Polar · tensorblock
Params14.2B
Context4K
Smallest5.3 GB
GGUF
SO
Changgil K2S3 SOLAR 11b v1.0
Solar · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
QW
Qwen2 7B Multilingual RP
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Roleplay
CU
Custom KoLLM 13B v2
Custom · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
CH
ChatTime 1 7B Base
Chattime · tensorblock
Params6.82B
Context4K
Smallest2.6 GB
GGUF
LL
LLaMA2_crosslingual_transfer_1
Llama · tensorblock
Params6.86B
Context4K
Smallest2.6 GB
GGUF
LL
Instruction Pretrain Finance Llama3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
MI
hlo world dolphin 2.1 mistral 7b tgi
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
MergeBench Llama 8B It Llama 3.1 8b It_Aya_2Epoch
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
QW
Qwen2.5 32B
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
GGUF
AR
Arch Function 1.5B
Arch · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
Tool use
LL
Mlabonne Hermes 3 Llama 3.1 8B Lorablated
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
QW
AiCloser Qwen2.5 32B AGI
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
GGUF
RI
Rizla 17b
Rizla · tensorblock
Params15.6B
Context32K
Smallest5.8 GB
GGUF
ME
Metharme 7b
Metharme · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
ME
Adarshkumardalai Mental Health Chatbot
Mental · tensorblock
Params82M
Context1K
Smallest0.1 GB
GGUF
MA
Magic Dolphin 7b
Magic · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
MO
model 6hs
Model · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
LL
Fireball Alpaca Llama3.1.07 8B Philos Math
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
SH
Shallow6414 Sn11 3 5 1
Shallow · tensorblock
Params27B
Context128K
Smallest10.5 GB
Coding
MI
agg shambhavi MimicLlama 3.1 8B DPO
Mimicllama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
YA
Yarn Solar 10b 32k
Yarn · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
KO
realPCH kosolra_SFT_DPO_v0
Kosolra · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
DP
Albertfares DPO_MCQA_model
Dpo · tensorblock
Params752M
Context32K
Smallest0.3 GB
Coding
QW
Eternis eternis_anonymizer_merge_Qwen3 0.6B_9jul_30k
Qwen · tensorblock
Params596M
Context40K
Smallest0.3 GB
GGUF
SW
NovaSky AI SWE Gym OpenHands 7B Agent
Swe · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
LL
Llama_2_13B
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF

Keep browsing