GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
DA
datagemma rig 27b it
Datagemma · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
QW
Oscar128372 Qwen2.5 CoderX 7B v0.5
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
WI
WizardLM 33B V1.0 Uncensored
Wizardlm · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
MI
Malhajar Mistral 7B v0.2 Meditron Turkish
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
QW
Huihui Ai Qwen2.5 Coder 14B Instruct Abliterated
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
QW
QwQ Math IO 500M
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
QW
Qwen Qwen2 57B A14B Instruct
Qwen · tensorblock
Params57.4B
Context32K
Smallest21.1 GB
DE
Openbuddy Deepseek 10b v17.1
DeepSeek · tensorblock
Params10.6B
Context4K
Smallest4.1 GB
TU
TucanoBR Tucano 1b1 Instruct
Tucano · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
QW
Huihui Ai Qwen2.5 7B Instruct Abliterated
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
LL
Llama 3 8B dutch
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GP
Gpt2 650k Stable Diffusion Prompt Generator
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
LL
Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GR
Ibm Granite Granite 7b Base
Granite · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
YI
Yi 34Bx2 MoE 60B
Yi · tensorblock
Params60.8B
Context195K
Smallest22.4 GB
LL
Roleplay Llama 3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
CO
Colinglab ConcreteGPT 124M 128ctx Strict Small Seq_Bins
Concretegpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
OP
Openchat 3.5 1210
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
MI
MixTAO 7Bx2 MoE v8.1
Mixtao · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
LL
Undi95 Meta Llama 3 8B Instruct Hf
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
SI
SILMA 9B Instruct v1.0
Silma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
BU
Bumblebee 7B
Bumblebee · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
Llama2.C stories110M
Llama · tensorblock
Params134M
Context1K
Smallest0.1 GB
MI
MiniCPM 2B dpo fp16
MiniCPM · tensorblock
Params2.72B
Context4K
Smallest1.2 GB
LL
Meta Llama Meta Llama 3 70B Instruct
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
DE
Qwen2.5 0.5B
DeepSeek · tensorblock
Params494M
Context32K
Smallest0.3 GB
LL
Dobby Mini Unhinged Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
XL
Salesforce xLAM 1b Fc R
Xlam · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
LL
Huggyllama Llama 13b
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB