GGUF models by tensorblock

4944 GGUF models quantized by tensorblock on Hugging Face. Sizes run from 1M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SK
NovaSky AI Sky T1 32B Preview
Sky · tensorblock
Params32.8B
Context32K
Smallest12.3 GB
Tool use
AL
CompassioninMachineLearning Alpacallama_Plus1K_80_20Mix
Alpacallama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
SA
Sail Sailor 1.8B
Sailor · tensorblock
Params1.84B
Context8K
Smallest0.8 GB
GGUF
MI
Noromaid v0.4 Mixtral Instruct 8x7b Zloss
Mistral · tensorblock
Params46.7B
Context32K
Smallest17.3 GB
GGUF
JA
Menlo Jan Nano
Jan · tensorblock
Params4.02B
Context40K
Smallest1.7 GB
ReasoningTool use
LL
Q Bert Llama 450m
Llama · tensorblock
Params465M
Context2K
Smallest0.2 GB
GGUF
SS
SSH 355M
Ssh · tensorblock
Params406M
Context1K
Smallest0.2 GB
CodingTool use
LL
WebSquareAI Instruct llama 3 8B v0.5.39
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
PU
PULI LlumiX 32K
Puli · tensorblock
Params6.74B
Context32K
Smallest2.5 GB
GGUF
DE
Deepseek R1 Distill NSFW RPv1
DeepSeek · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
ReasoningTool use
SY
Migtissera Synthia 7B v3.0
Synthia · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
LL
TheTravellingEngineer llama2 7b chat hf v3
Llama · tensorblock
Params6.74B
Context4K
Smallest2.5 GB
GGUF
SI
Sina Odin 7b Merge
Sina · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
BF
BFS Prover
Bfs · tensorblock
Params7.62B
Context4K
Smallest3.0 GB
Tool use
LL
Llama 30b Instruct 2048
Llama · tensorblock
Params32.5B
Context2K
Smallest12.0 GB
GGUF
LL
Dmis Lab Llama 3.1 Medprm Reward v1.0
Llama · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
Tool use
AI
airoboros 2.2.1 y34b
Airoboros · tensorblock
Params34.4B
Context4K
Smallest12.8 GB
GGUF
IN
InternLM2StepProver
InternLM · tensorblock
Params7.74B
Context8K
Smallest3.0 GB
GGUF
SU
L3.1 Suze Vume calc
Suze · tensorblock
Params8.03B
Context128K
Smallest3.2 GB
GGUF
LL
Henrychur MMed Llama 3 8B EnIns
Llama · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
SA
SamirGPT v1
Samirgpt · tensorblock
Params7.24B
Context32K
Smallest2.7 GB
GGUF
JI
Jingyeom Yi Ko_3_1_7
tensorblock
Params6.18B
Context2K
Smallest2.4 GB
GGUF
GR
Ibm Granite Granite 3.3 2b Instruct
Granite · tensorblock
Params2.53B
Context128K
Smallest1.0 GB
ReasoningTool use
DA
DataVortexTL 1.1B v0.1
Datavortextl · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
MI
Vezora Mistral 22B v0.2
Mistral · tensorblock
Params22.2B
Context64K
Smallest8.3 GB
GGUF
RP
Rpguild Chatml 13b
Rpguild · tensorblock
Params13B
Context4K
Smallest4.9 GB
Roleplay
QW
ArliAI QwQ 32B ArliAI RpR v4
Qwen · tensorblock
Params32.8B
Context40K
Smallest12.3 GB
ReasoningTool use
OP
openchat 3.6 8b 20240522
Openchat · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
LL
Llama 3.2 1B
Llama · tensorblock
Params1.24B
Context128K
Smallest0.6 GB
GGUF
CO
Danielbrdz CodeBarcenas 7b
Codebarcenas · tensorblock
Params6.74B
Context16K
Smallest2.5 GB
GGUF

Keep browsing