GGUF models by Eric111

34 GGUF models quantized by Eric111 on Hugging Face. Sizes run from 268M to 13B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
UL
UltraCatunaMayo
Ultracatunamayo · Eric111
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BA
bagel dpo 7b v0.1
Bagel · Eric111
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
neuronovo 9B v0.4
Neuronovo · Eric111
Params8.99B
Context32K
Q4_K_M5.4 GB
GGUF
OP
openchat 3.5 0106 128k DPO
Openchat · Eric111
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF

Keep browsing