GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
GR
GritLM 8x7B
Gritlm · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
PH
Phi 2 Orange v2
Phi · tensorblock
Params2.78B
Context2K
Smallest1.1 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · tensorblock
Params16M
Context128K
Smallest0.0 GB
CA
calme-3.2-baguette-3b
Calme · tensorblock
Params3.09B
Context32K
Smallest1.3 GB
GE
scb10x typhoon2.1 gemma3 12b
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
LL
Alpindale Llama 3.2 3B
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
IN
Yi Ko 6B
Instruct · tensorblock
Params6.18B
Context2K
Smallest2.4 GB
FA
gpt4all falcon
Falcon · tensorblock
Params7.22B
Context2K
Smallest3.9 GB
GE
Soob3123 Amoral Gemma3 12B v2
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
CA
Captain Eris Violet V0.420 12B
Captain · tensorblock
Params12.2B
Context1000K
Smallest4.8 GB
PO
Ibm Research PowerMoE 3b
Powermoe · tensorblock
Params3.37B
Context4K
Smallest1.3 GB
PA
palmer 002
Palmer · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
SH
Shisa Base 7b v1
Shisa · tensorblock
Params7.96B
Context32K
Smallest3.1 GB
OP
Cockroach54 Opensolar Qlora Dpo
Opensolar · tensorblock
Params10.9B
Context4K
Smallest4.1 GB
LL
Llama 3.1 8B Instruct
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
SO
solar megamerge dare 10.7b v1
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
ruadapt llama2 7b v0.1
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GP
Openai Community Gpt2 Medium
Gpt · tensorblock
Params406M
Context1K
Smallest0.2 GB
VI
Vikhr 7B instruct 0.4
Vikhr · tensorblock
Params7.63B
Context32K
Smallest2.9 GB
YI
Wenbopan Faro Yi 9B DPO
Yi · tensorblock
Params8.83B
Context32K
Smallest3.4 GB
RE
MM ReMM L2 20B
Remm · tensorblock
Params20B
Context4K
Smallest7.4 GB
HU
FreedomIntelligence HuatuoGPT O1 72B
Huatuogpt · tensorblock
Params72.7B
Context32K
Smallest29.8 GB
LL
AVA Llama 3
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
NO
NeverSleep Noromaid 13b v0.2
Noromaid · tensorblock
Params13B
Context4K
Smallest4.9 GB
QW
Huihui Ai Qwen2.5 Coder 32B Instruct Abliterated
Qwen · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
MI
MiniusLight 24B v1.01
Miniuslight · tensorblock
Params23.6B
Context32K
Smallest8.9 GB
SY
MiniMaxAI SynLogic 7B
Synlogic · tensorblock
Params7.62B
Context128K
Smallest3.0 GB
MI
Mistral7B PairRM SPPO Iter3
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
PY
EleutherAI Pythia 1.4b
Pythia · tensorblock
Params1.41B
Context2K
Smallest0.6 GB
GP
Uer Gpt2 Large Chinese Cluecorpussmall
Gpt · tensorblock
Params764M
Context1K
Smallest0.3 GB