GGUF models by Eric111
34 GGUF models quantized by Eric111 on Hugging Face. Sizes run from 268M to 13B parameters. The longest trained context is 128K tokens.
UL
UltraCatunaMayo
Ultracatunamayo · Eric111
Params7.24B
Context32K
Q4_K_M4.4 GB
BA
bagel dpo 7b v0.1
Bagel · Eric111
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
neuronovo 9B v0.4
Neuronovo · Eric111
Params8.99B
Context32K
Q4_K_M5.4 GB
OP
openchat 3.5 0106 128k DPO
Openchat · Eric111
Params7.24B
Context128K
Q4_K_M4.4 GB