GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
LL
Llama Song Stream 3B Instruct
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
QW
qwen2.5 1.5b 500k O3 16kcw 2ep risc
Qwen · tensorblock
Params1.78B
Context32K
Smallest0.8 GB
EA
EastAsia 4x7B Moe experiment
Eastasia · tensorblock
Params18.5B
Context32K
Smallest6.8 GB
LL
llama 2 7b nf4 fp16 upscaled
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
llama3 pre1 pre2 ins1 lora3
Llama · tensorblock
Params8.2B
Context8K
Smallest3.3 GB
LD
Colable LDCC CCK Slerp
Ldcc · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
FI
FinMatcha 3B Instruct
Finmatcha · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
TI
TinyLlama TinyLlama_v1.1
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
LL
llama2 9m fresh
Llama · tensorblock
Params10M
Context2K
Smallest0.0 GB
GE
Gemma 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MI
Hercules 2.5 Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OL
OLMo-2-1124-7B-Instruct_SFTv02.00
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
UI
Tesslate UIGEN X 32B 0727
Uigen · tensorblock
Params32.8B
Context40K
Smallest12.3 GB
QW
XXsongLALA Qwen 2.5 7B Base RAG RL
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
MI
Mixtral_AI_Cyber_4.0
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
BA
Nytopop 1b_or_base
Base · tensorblock
Params1.29B
Context128K
Smallest0.6 GB
ME
Microsoft MediPhi Instruct
Mediphi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
LL
MergeBench Llama 3.1 8B coding
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
QW
MN 2407 DSK QwQify v0.1 12B
Qwen · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
LL
Etri Xainlp Llama2 13b Lima Sft Dpo
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
SO
Tanitan2 SOLAR 10.7B Instruct T3Q Ko Solar Dpo Slerp
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
KO
TeamUNIVA Komodo_6B_v3.0.0
Komodo · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
RO
Rmanluo RoG
Rog · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
FA
FastApply 1.5B v1.0
Fastapply · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
MI
Minerva 3B base RAG
Minerva · tensorblock
Params2.89B
Context16K
Smallest1.1 GB
LL
Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
LL
Dim Tiny Llama 2T Open Orca Ru 10000 Step
Llama · tensorblock
Params1.1B
Context4K
Smallest0.4 GB
FA
Falcon3 Mamba R1 v0
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB