GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PI
piccolo 8x7b
Piccolo · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
GO
HiTZ GoLLIE 34B
Gollie · tensorblock
Params33.7B
Context16K
Smallest12.5 GB
Coding
MI
Abhishekchohan Mistral 7B Forest Dpo
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
RA
RakutenAI 7B Instruct
Rakutenai · tensorblock
Params7.37B
Context32K
Smallest2.8 GB
GGUF
PY
Ajibawa 2023 Python Code 33B
Python · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
Coding
MI
Ja Ck Mistral Instruct Y24 v6
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
llama3 8B slerp biomed chat chinese
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Clinical BR LlaMA 2 7B
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
MI
cognitivecomputations samantha mistral instruct 7b
Mistral · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
OP
OPEN SOLAR KO 10.7B
Open · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
GGUF
LL
MrBananaHuman Llama_Model_Test
Llama · tensorblock
Params12M
Context512
Smallest0.0 GB
GGUF
NY
Nyxene v3 11B
Nyxene · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
HU
FreedomIntelligence HuatuoGPT O1 70B
Huatuogpt · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
ReasoningTool use
LL
llama3 1 8b 4o annotated math
Llama · tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
YI
Nous Hermes 2 Yi 34B
Yi · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
Tool use
NE
ServiceNow AI Apriel Nemotron 15b Thinker
Nemotron · tensorblock
Params15B
Context64K
Smallest5.8 GB
ReasoningTool use
SO
Mssma Ko Solar 10.7b v0.7
Solar · tensorblock
Params10.9B
Context2K
Smallest4.1 GB
GGUF
LL
Lcw99 Llama2 Ko Chang Instruct Chat
Llama · tensorblock
Params6.86B
Context4K
Smallest2.6 GB
GGUF
DA
H2O Danube2 1.8b Base
Danube · tensorblock
Params1.83B
Context8K
Smallest0.7 GB
GGUF
BR
go bruins v2.1.1
Bruins · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
SO
Changgil K2S3 SOLAR 11b v4.0
Solar · tensorblock
Params10.7B
Context4K
Smallest4.0 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · tensorblock
Params70.6B
Context128K
Smallest26.4 GB
Tool use
MO
Moe_Scratch
Moe · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
KO
Kollama2 7b v0
Kollama · tensorblock
Params6.74B
Context2K
Smallest2.5 GB
GGUF
S1
s1.1 7B
tensorblock
Params7.62B
Context32K
Smallest3.0 GB
Tool use
BA
fireballoon baichuan vicuna chinese 7b
Baichuan · tensorblock
Params7B
Context4K
Smallest2.7 GB
GGUF
IN
Internlm2_5 Step Prover
InternLM · tensorblock
Params7.74B
Context8K
Smallest3.0 GB
GGUF
HU
FreedomIntelligence HuatuoGPT O1 8B
Huatuogpt · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ReasoningTool use
HE
Kyutai Helium 1 2b
Helium · tensorblock
Params2.02B
Context4K
Smallest0.8 GB
GGUF
LL
Llama 3.2 Rabbit Ko 3B Instruct
Llama · tensorblock
Params3.21B
Context128K
Smallest1.4 GB
GGUF

Keep browsing