GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama Song Stream 3B Instruct
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
QW
qwen2.5 1.5b 500k O3 16kcw 2ep risc
Qwen · tensorblock
Params1.78B
Context32K
Smallest0.8 GB
Tool use
EA
EastAsia 4x7B Moe experiment
Eastasia · tensorblock
Params18.5B
Context32K
Smallest6.8 GB
GGUF
LL
llama 2 7b nf4 fp16 upscaled
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
llama3 pre1 pre2 ins1 lora3
Llama · tensorblock
Params8.2B
Context8K
Smallest3.3 GB
GGUF
LD
Colable LDCC CCK Slerp
Ldcc · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
FI
FinMatcha 3B Instruct
Finmatcha · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
TI
TinyLlama TinyLlama_v1.1
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
LL
llama2 9m fresh
Llama · tensorblock
Params10M
Context2K
Smallest0.0 GB
GGUF
GE
Gemma 2b
Gemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
LL
Llama 2 7b Chat Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MI
Hercules 2.5 Mistral 7B
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
Coding
NE
NeuralLlama 3 8B Instruct abliterated
Neuralllama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OL
OLMo-2-1124-7B-Instruct_SFTv02.00
OLMo · tensorblock
Params7.3B
Context4K
Smallest2.9 GB
Reasoning
UI
Tesslate UIGEN X 32B 0727
Uigen · tensorblock
Params32.8B
Context40K
Smallest12.3 GB
ReasoningTool use
QW
XXsongLALA Qwen 2.5 7B Base RAG RL
Qwen · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
MI
Mixtral_AI_Cyber_4.0
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
BA
Nytopop 1b_or_base
Base · tensorblock
Params1.29B
Context128K
Smallest0.6 GB
GGUF
ME
Microsoft MediPhi Instruct
Mediphi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
LL
MergeBench Llama 3.1 8B coding
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
QW
MN 2407 DSK QwQify v0.1 12B
Qwen · tensorblock
Params12.2B
Context128K
Smallest4.8 GB
Reasoning
LL
Etri Xainlp Llama2 13b Lima Sft Dpo
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
SO
Tanitan2 SOLAR 10.7B Instruct T3Q Ko Solar Dpo Slerp
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
KO
TeamUNIVA Komodo_6B_v3.0.0
Komodo · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
RO
Rmanluo RoG
Rog · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
FA
FastApply 1.5B v1.0
Fastapply · tensorblock
Params1.54B
Context32K
Smallest0.7 GB
GGUF
MI
Minerva 3B base RAG
Minerva · tensorblock
Params2.89B
Context16K
Smallest1.1 GB
GGUF
LL
Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GGUF
LL
Dim Tiny Llama 2T Open Orca Ru 10000 Step
Llama · tensorblock
Params1.1B
Context4K
Smallest0.4 GB
GGUF
FA
Falcon3 Mamba R1 v0
Falcon · tensorblock
Params7.27B
Context1024K
Smallest2.6 GB
Reasoning

Keep browsing