GGUF models by tensorblock
4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.
PI
piccolo 8x7b
Piccolo · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GO
HiTZ GoLLIE 34B
Gollie · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
MI
Abhishekchohan Mistral 7B Forest Dpo
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
RA
RakutenAI 7B Instruct
Rakutenai · tensorblock
Params7.37B
Context32K
Smallest2.8 GB
PY
Ajibawa 2023 Python Code 33B
Python · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
MI
Ja Ck Mistral Instruct Y24 v6
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
LL
llama3 8B slerp biomed chat chinese
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
LL
Clinical BR LlaMA 2 7B
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
MI
cognitivecomputations samantha mistral instruct 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
OP
OPEN SOLAR KO 10.7B
Open · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
LL
MrBananaHuman Llama_Model_Test
Llama · tensorblock
Params12M
Context512
Smallest0.0 GB
NY
Nyxene v3 11B
Nyxene · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
HU
FreedomIntelligence HuatuoGPT O1 70B
Huatuogpt · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
LL
llama3 1 8b 4o annotated math
Llama · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
YI
Nous Hermes 2 Yi 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
NE
ServiceNow AI Apriel Nemotron 15b Thinker
Nemotron · tensorblock
Params15B
Context64K
Smallest5.8 GB
SO
Mssma Ko Solar 10.7b v0.7
Solar · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
LL
Lcw99 Llama2 Ko Chang Instruct Chat
Llama · tensorblock
Params6.86B
Context4K
Smallest2.6 GB
DA
H2O Danube2 1.8b Base
Danube · tensorblock
Params1.83B
Context8K
Smallest0.7 GB
BR
go bruins v2.1.1
Bruins · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
SO
Changgil K2S3 SOLAR 11b v4.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
LL
Meta Llama 3.1 70B Instruct
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
MO
Moe_Scratch
Moe · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
KO
Kollama2 7b v0
Kollama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
S1
s1.1 7B
tensorblock
Params7.62B
Context32K
Smallest3.0 GB
BA
fireballoon baichuan vicuna chinese 7b
Baichuan · tensorblock
Params7B
Context4K
Smallest2.7 GB
IN
Internlm2_5 Step Prover
InternLM · tensorblock
Params7.74B
Context8K
Smallest3.0 GB
HU
FreedomIntelligence HuatuoGPT O1 8B
Huatuogpt · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
HE
Kyutai Helium 1 2b
Helium · tensorblock
Params2.02B
Context4K
Smallest0.8 GB
LL
Llama 3.2 Rabbit Ko 3B Instruct
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB