GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DA
datagemma rig 27b it
Datagemma · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
GGUF
QW
Oscar128372 Qwen2.5 CoderX 7B v0.5
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
CodingTool use
WI
WizardLM 33B V1.0 Uncensored
Wizardlm · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
GGUF
MI
Malhajar Mistral 7B v0.2 Meditron Turkish
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
QW
Huihui Ai Qwen2.5 Coder 14B Instruct Abliterated
Qwen · tensorblock
Params14.8B
Context32K
Smallest5.8 GB
CodingTool use
QW
QwQ Math IO 500M
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
ReasoningTool use
QW
Qwen Qwen2 57B A14B Instruct
Qwen · tensorblock
Params57.4B
Context32K
Smallest21.1 GB
GGUF
DE
Openbuddy Deepseek 10b v17.1
DeepSeek · tensorblock
Params10.6B
Context4K
Smallest4.1 GB
GGUF
TU
TucanoBR Tucano 1b1 Instruct
Tucano · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
QW
Huihui Ai Qwen2.5 7B Instruct Abliterated
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
LL
Llama 3 8B dutch
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GP
Gpt2 650k Stable Diffusion Prompt Generator
Gpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
Coding
LL
Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
GR
Ibm Granite Granite 7b Base
Granite · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
YI
Yi 34Bx2 MoE 60B
Yi · tensorblock
Params60.8B
Context195K
Smallest22.4 GB
GGUF
LL
Roleplay Llama 3 8B
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Roleplay
CO
Colinglab ConcreteGPT 124M 128ctx Strict Small Seq_Bins
Concretegpt · tensorblock
Params163M
Context1K
Smallest0.1 GB
GGUF
AI
Yi Ko 6B
Aift · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
OP
Openchat 3.5 1210
Openchat · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
MI
MixTAO 7Bx2 MoE v8.1
Mixtao · tensorblock
Params12.9B
Context32K
Smallest4.8 GB
GGUF
LL
Undi95 Meta Llama 3 8B Instruct Hf
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SI
SILMA 9B Instruct v1.0
Silma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
BU
Bumblebee 7B
Bumblebee · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
Llama2.C stories110M
Llama · tensorblock
Params134M
Context1K
Smallest0.1 GB
GGUF
MI
MiniCPM 2B dpo fp16
MiniCPM · tensorblock
Params2.72B
Context4K
Smallest1.2 GB
GGUF
LL
Meta Llama Meta Llama 3 70B Instruct
Llama · tensorblock
Params70.6B
Context8K
Smallest26.4 GB
GGUF
DE
Qwen2.5 0.5B
DeepSeek · tensorblock
Params494M
Context32K
Smallest0.3 GB
ReasoningTool use
LL
Dobby Mini Unhinged Llama 3.1 8B
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
RoleplayTool use
XL
Salesforce xLAM 1b Fc R
Xlam · tensorblock
Params1.35B
Context16K
Smallest0.6 GB
Tool use
LL
Huggyllama Llama 13b
Llama · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF

Keep browsing