GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
JenniferHJF Qwen1.5 Emoji Finetuned
Qwen · tensorblock
Params1.84B
Context32K
Smallest0.8 GB
LL
H2Ogpt 4096 Llama2 7b Chat
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MO
Moe X33
Moe · tensorblock
Params58.9B
Context16K
Smallest21.6 GB
LL
Hermes 2 Theta Llama 3 8B 32k
Llama · tensorblock
Params8.03B
Context32K
Smallest3.2 GB
MI
MistralLite
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
Qwen2.5-0.5B-Instruct-Gensyn-Swarm-hardy_hulking_cockroach
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
OR
OH original wo null sources
Original · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Phind Phind CodeLlama 34B Python v1
Llama · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
MI
Decem Dionysus Mistral M3 v5
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
YI
Azure99 Blossom v4 Yi 34b
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
QW
Yuuta208 Qwen2.5 7B Instruct Qwen2.5 Math 7B Merged Task_Arithmetic 26
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
OL
Allenai OLMo 1B Hf
OLMo · tensorblock
Params1.18B
Context2K
Smallest0.5 GB
YY
Yyh0901 666
tensorblock
Params6.74B
Context64K
Smallest2.5 GB
LL
KBNIT Llama 2 Koen 13b QLoRA NEFTune Kolon v0.1
Llama · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
DR
DRT O1 14B
Drt · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
LL
zhangchuheng123 llama2 alpaca sft 2epoch
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
RLHFlow Pair Preference Model LLaMA3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
MI
Mistral Small3 24B InstructContinuedFine
Mistral · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
LL
llama 2 13b chat platypus
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
MO
MonarchLake 7B
Monarchlake · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
AR
Archaeo 12B
Archaeo · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
LL
Choco9966 Llama 2 7b Instruct Tuning
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
CK
Ybq0509 sc_Q_32B_ckpt1124
Ckpt · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
MO
MoE 13B DPO
Moe · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
ST
Storm 7B
Storm · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
SA
Sail Sailor2 20B Chat
Sailor · tensorblock
Params19.2B
Context4K
Smallest7.4 GB
QW
Jan Hq Qwen3 4B No Think
Qwen · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
CY
Cybersentinal 2.0 10
Cybersentinal · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GA
prithivMLmods Gauss Opus 14B R999
Gauss · tensorblock
Params16M
Context128K
Smallest0.0 GB
AF
Alphatao Affine 5246433
Affine · tensorblock
Params8.19B
Context40K
Smallest3.3 GB