Prototype GGUF models

301 GGUF models in the Prototype family, quantized by 8 uploaders. Sizes run from 738M to 125B parameters. The longest trained context is 1000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
PR
Prototype 0.4x317
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x313
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x3
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x17
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x23
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x52
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x256
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
prototype 0.1 Q4 K
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x14
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x24
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x38
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x41
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x46
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x51
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x56
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x60
Prototype · bruhzair
Params70.6B
Context128K
Smallest42.5 GB
GGUF
PR
Prototype 0.4x134
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x146
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x148
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x161
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x160
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x207
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x215
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x219
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x237
Prototype · bruhzair
Params70.6B
Context128K
Smallest57.9 GB
GGUF
PR
Prototype 0.4x261
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x269
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x292
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x309
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF
PR
Prototype 0.4x321
Prototype · bruhzair
Params70.6B
Context128K
Smallest75.0 GB
GGUF

Keep browsing