GGUF models by brittlewis12
98 GGUF models quantized by brittlewis12 on Hugging Face. Sizes run from 268M to 70.6B parameters. The longest trained context is 256K tokens.
WE
WestBeagle 7B
Westbeagle · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenCodeInterpreter-SC2-3B
Opencodeinterpreter · brittlewis12
Params3.18B
Context16K
Q4_K_M2.0 GB
OP
openchat-3.6-8b-20240522
Openchat · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
InternLM2
InternLM · brittlewis12
Params1.89B
Context32K
Q4_K_M1.2 GB
LL
Llama-3-Refueled
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
NO
Noromaid 7B 0.4 DPO
Noromaid · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StructLM 7B
Structlm · brittlewis12
Params6.74B
Context16K
Q4_K_M4.1 GB
GE
Genstruct 7B
Genstruct · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB