GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3 Debug
Llama · tensorblock
Params17M
Context8K
Smallest0.0 GB
GGUF
AR
Arch Function 7B
Arch · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
QW
Qwen Qwen2 VL 7B
Qwen · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Vision
LL
Meta Llama 3 8B Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Tool use
MA
MARS
Mars · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Meta Llama 3 8B Instruct
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
OP
OpenMistral MoE
Openmistral · tensorblock
Params24.2B
Context32K
Smallest8.8 GB
GGUF
PY
EleutherAI Pythia 410m Deduped
Pythia · tensorblock
Params405M
Context2K
Smallest0.2 GB
GGUF
OM
Omni Reasoner2 Merged
Omni · tensorblock
Params14.7B
Context16K
Smallest5.6 GB
GGUF
QW
Vikhr-Qwen-2.5-0.5b-Instruct
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
Tool use
DE
Deepseek Ai Deepseek Math 7b Rl
DeepSeek · tensorblock
Params6.91B
Context4K
Smallest2.7 GB
GGUF
LL
Llama 3 8b
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
VI
Luckychao Vicuna Backdoored 7B
Vicuna · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
PL
ko platypus kiwi 13B
Platypus · tensorblock
Params13B
Context2K
Smallest4.9 GB
GGUF
PY
EleutherAI Pythia 2.8b
Pythia · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
KA
Karakuri Lm 8x7b Instruct v0.1
Karakuri · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
CodingTool use
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
RoleplayTool use
CH
jeiku Chaos RP l3 8B
Chaos · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
Roleplay
MI
Open Orca Mistral 7B OpenOrca
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
KISTI KONI KONI Llama3.1 8B Instruct 20241024
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
TA
prithivMLmods Tadpole Opus 14B Exp
Tadpole · tensorblock
Params14.8B
Context986K
Smallest5.8 GB
Tool use
QW
Qwq Bakeneko 32b
Qwen · tensorblock
Params32.8B
Context128K
Smallest12.3 GB
ReasoningTool use
QW
Huihui Ai QwQ 32B Coder Fusion 9010
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
CodingReasoningTool use
TH
PKU ONELab Themis
Themis · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
GI
Abacusai Giraffe 13b 32k v3
Giraffe · tensorblock
Params13B
Context32K
Smallest4.9 GB
GGUF
SA
Salamandra 7b Instruct
Salamandra · tensorblock
Params7.77B
Context8K
Smallest3.3 GB
Coding
GE
INSAIT Institute BgGPT Gemma 2 2.6B IT v1.0
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
LL
Llama 3.2 3B Instruct Medical Conversational
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
Tool use
GE
Mlabonne Gemma 3 12b It Abliterated v2
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
Vision
BR
ReadyArt Broken Tutu 24B Unslop v2.0
Broken · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
Roleplay

Keep browsing