Prototype GGUF models

301 GGUF models in the Prototype family, quantized by 8 uploaders. Sizes run from 738M to 125B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PR
Prototype 0.4x153
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x155
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x177
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x191
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x194
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x220
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x227
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x240
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x243
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x259
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x2
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
prototype 0.2 Q4 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x8
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x15
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x18
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x20
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x21
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x22
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x27
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x28
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x29
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x30
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x31
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x33
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x49
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x54
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x55
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x72
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x74
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x75
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF

Keep browsing