GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
QW
Mdobbali Qwen2.5 7B Instruct 131K
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
KO
KoRAE 13b
Korae · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
MI
Winglian Mistral 11b 128k
Mistral · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
LL
llama ko peft v0.6
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
OT
Genne Otter3.1.3_7B
Otter · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
PH
Moxoff Phi3Mini PPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
SO
Etri Xainlp SOLAR 10.7B Merge Dpo_V1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GE
GEITje 7B ultra
Geitje · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
KU
Kuro Lotus 10.7B
Kuro · tensorblock
Params10.7B
Context8K
Smallest4.0 GB
LL
Llama 3.2 1B Instruct
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
QW
Qwen2 1.5B
Qwen · tensorblock
Params1.54B
Context128K
Smallest0.7 GB
ZE
zephyr 7b sft full
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CH
Changgil K2S3 14b v0.2
tensorblock
Params14.4B
Context32K
Smallest5.4 GB
LL
Userb1az Llama2 7b Fp16
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LO
LongAlign 7B 64k Base
Longalign · tensorblock
Params6.74B
Context64K
Smallest2.5 GB
TR
FusionNet_34Bx2_MoE
Truthful · tensorblock
Params60.8B
Context32K
Smallest22.4 GB
PI
PiVoT SOLAR 10.7B RP
Pivot · tensorblock
Params10.7B
Context8K
Smallest4.0 GB
YO
Rinna Youri 7b Instruction
Youri · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
SO
hk SOLAR 10.7B v1.1
Solar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
LL
LLaMA3 Iterative DPO Final
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SO
Kyujinpy SOLAR Platypus 10.7B v2
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
Llama 2 7b Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
LL
OhCherryFire Llama2 7b Game24 Policy Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MI
Cognitivecomputations Dolphin 2.6 Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
LL
Llama 3 Instruct 8B SPPO Iter3 SimPO Merge
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GE
Gemma 7b It
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
FU
FusionNet_7Bx2_MoE_14B
Fusionnet · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
GR
Ibm Granite Granite 3.1 2b Base
Granite · tensorblock
Params2.53B
Context128K
Smallest1.0 GB
QW
Qwen1.5 7B Dutch Chat
Qwen · tensorblock
Params7.72B
Context32K
Smallest3.1 GB