GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
GritLM 8x7B
Gritlm · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
PH
Phi 2 Orange v2
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
GGUF
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · tensorblock
Params16M
Context128K
Smallest0.0 GB
ReasoningTool use
CA
calme-3.2-baguette-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
GGUF
GE
scb10x typhoon2.1 gemma3 12b
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
ReasoningTool use
LL
Alpindale Llama 3.2 3B
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
GGUF
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
FA
gpt4all falcon
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
GGUF
GE
Soob3123 Amoral Gemma3 12B v2
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
GGUF
CA
Captain Eris Violet V0.420 12B
Captain · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
Tool use
PO
Ibm Research PowerMoE 3b
Powermoe · tensorblock
Params3.37B
Context4K
Smallest1.3 GB
GGUF
PA
palmer 002
Palmer · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
SH
Shisa Base 7b v1
Shisa · tensorblock
Params7.96B
Context32K
Smallest3.1 GB
GGUF
OP
Cockroach54 Opensolar Qlora Dpo
Opensolar · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
GGUF
LL
Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
SO
solar megamerge dare 10.7b v1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
ruadapt llama2 7b v0.1
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
GP
Openai Community Gpt2 Medium
Gpt · tensorblock
Params406M
Context1K
Smallest0.2 GB
GGUF
VI
Vikhr 7B instruct 0.4
Vikhr · tensorblock
Params7.63B
Context32K
Smallest2.9 GB
GGUF
YI
Wenbopan Faro Yi 9B DPO
Yi · tensorblock
Params8.83B
Context32K
Smallest3.4 GB
GGUF
RE
MM ReMM L2 20B
Remm · tensorblock
Params20B
Context4K
Smallest7.4 GB
GGUF
HU
FreedomIntelligence HuatuoGPT O1 72B
Huatuogpt · tensorblock
Params72.7B
Context32K
Smallest29.8 GB
ReasoningTool use
LL
AVA Llama 3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
NO
NeverSleep Noromaid 13b v0.2
Noromaid · tensorblock
Params13B
Context4K
Smallest4.9 GB
GGUF
QW
Huihui Ai Qwen2.5 Coder 32B Instruct Abliterated
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
CodingTool use
MI
MiniusLight 24B v1.01
Miniuslight · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
GGUF
SY
MiniMaxAI SynLogic 7B
Synlogic · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
Tool use
MI
Mistral7B PairRM SPPO Iter3
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
PY
EleutherAI Pythia 1.4b
Pythia · tensorblock
Params1.41B
Context2K
Smallest0.6 GB
GGUF
GP
Uer Gpt2 Large Chinese Cluecorpussmall
Gpt · tensorblock
Params764M
Context1K
Smallest0.3 GB
GGUF

Keep browsing