GGUF models by brittlewis12

98 GGUF models quantized by brittlewis12 on Hugging Face. Sizes run from 268M to 70.6B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
WE
WestBeagle 7B
Westbeagle · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenCodeInterpreter-SC2-3B
Opencodeinterpreter · brittlewis12
Params3.18B
Context16K
Q4_K_M2.0 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
InternLM2
InternLM · brittlewis12
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
LL
Llama-3-Refueled
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NO
Noromaid 7B 0.4 DPO
Noromaid · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StructLM 7B
Structlm · brittlewis12
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
GE
Genstruct 7B
Genstruct · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing