GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
DE
deepseekmath 7b sft GSM8K
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
LL
Configurable Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
SO
Krevas SOLAR 10.7B
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
QW
Spow12 Qwen2 7B Ko Instruct Orpo Ver_2.0_Wo_Chat
Qwen · tensorblock
Params7.61B
Context128K
Smallest3.0 GB
QW
Alibaba Pai Pai Qwen1_5 0b5 Doc2Qa
Qwen · tensorblock
Params620M
Context32K
Smallest0.3 GB
TY
typhoon 7b
Typhoon · tensorblock
Params7.27B
Context32K
Smallest2.7 GB
MH
H2M Mhm 7b v1.3
Mhm · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
ME
megatron v1
Megatron · tensorblock
Params12.9B
Context8K
Smallest4.8 GB
LL
Featherless Chat Models Llama2 13b Chat Hf
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
LL
Kenken6696 Llama 3.2 1B_3x1_mix_position_known_unknown_v2
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
SA
salamandraTA 2b Instruct
Salamandrata · tensorblock
Params2.25B
Context8K
Smallest1.1 GB
QW
GRPO-Qwen3-0.6B
Qwen · tensorblock
Params596M
Context40K
Smallest0.3 GB
LL
MFANN llama3.1 Abliterated SLERP
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
RE
RekaAI Reka Flash 3
Reka · tensorblock
Params20.9B
Context32K
Smallest8.6 GB
LL
s1K llama3.1 8b 32kcontext
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GE
Aisingapore Gemma2 9b Cpt Sea Lionv3 Base
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
LL
Xz97 AlpaCare Llama2 13b
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
PH
phi 2 instruct
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
DA
DataVortexS 10.7B Dpo v1.1
Datavortexs · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
LO
Locutusque LocutusqueXFelladrin TinyMistral248M Instruct
Locutusquexfelladrin · tensorblock
Params248M
Context32K
Smallest0.1 GB
LL
BAAI Infinity Instruct 3M 0625 Llama3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
OR
Orca SOLAR 4x10.7b
Orca · tensorblock
Params36.1B
Context4K
Smallest13.2 GB
MI
Mistral_Tv Neural Marconroni
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
EX
Yam Peleg Experiment27 7B
Experiment · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
Qwen CodeQwen1.5 7B
Qwen · tensorblock
Params7.25B
Context64K
Smallest3.1 GB
MI
SON Mistral 7B QLoRA Peft
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
wei123602 llama2 13b fintune2
Llama · tensorblock
Params13B
Context4K
Smallest4.9 GB
LI
Saxo Linkbricks Horizon AI Korean Superb 22B
Linkbricks · tensorblock
Params22.2B
Context32K
Smallest8.3 GB
RE
reader lm 1.5b
Reader · tensorblock
Params1.54B
Context250K
Smallest0.7 GB
LL
Rinna Llama 3 Youko 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB