GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Mdobbali Qwen2.5 7B Instruct 131K
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
KO
KoRAE 13b
Korae · tensorblock
Params13.2B
Context2K
Smallest4.9 GB
GGUF
MI
Winglian Mistral 11b 128k
Mistral · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
LL
llama ko peft v0.6
Llama · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
OT
Genne Otter3.1.3_7B
Otter · tensorblock
Params6.86B
Context2K
Smallest2.6 GB
GGUF
PH
Moxoff Phi3Mini PPO
Phi · tensorblock
Params3.82B
Context128K
Smallest1.4 GB
GGUF
SO
Etri Xainlp SOLAR 10.7B Merge Dpo_V1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
GE
GEITje 7B ultra
Geitje · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
KU
Kuro Lotus 10.7B
Kuro · tensorblock
Params10.7B
Context8K
Smallest4.0 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
CodingTool use
QW
Qwen2 1.5B
Qwen · tensorblock
Params1.54B
Context128K
Smallest0.7 GB
GGUF
ZE
zephyr 7b sft full
Zephyr · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
CH
Changgil K2S3 14b v0.2
tensorblock
Params14.4B
Context32K
Smallest5.4 GB
GGUF
LL
Userb1az Llama2 7b Fp16
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LO
LongAlign 7B 64k Base
Longalign · tensorblock
Params6.74B
Context64K
Smallest2.5 GB
GGUF
TR
FusionNet_34Bx2_MoE
Truthful · tensorblock
Params60.8B
Context32K
Smallest22.4 GB
GGUF
PI
PiVoT SOLAR 10.7B RP
Pivot · tensorblock
Params10.7B
Context8K
Smallest4.0 GB
Roleplay
YO
Rinna Youri 7b Instruction
Youri · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
SO
hk SOLAR 10.7B v1.1
Solar · tensorblock
Params10.8B
Context4K
Smallest4.0 GB
GGUF
LL
LLaMA3 Iterative DPO Final
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SO
Kyujinpy SOLAR Platypus 10.7B v2
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
Llama 2 7b Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
LL
OhCherryFire Llama2 7b Game24 Policy Hf
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MI
Cognitivecomputations Dolphin 2.6 Mistral 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
CodingTool use
LL
Llama 3.1 8B Instruct Abliterated_Via_Adapter
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Llama 3 Instruct 8B SPPO Iter3 SimPO Merge
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GE
Gemma 7b It
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF
FU
FusionNet_7Bx2_MoE_14B
Fusionnet · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
GGUF
GR
Ibm Granite Granite 3.1 2b Base
Granite · tensorblock
Params2.53B
Context128K
Smallest1.0 GB
GGUF
QW
Qwen1.5 7B Dutch Chat
Qwen · tensorblock
Params7.72B
Context32K
Smallest3.1 GB
GGUF

Keep browsing