GGUF models by brittlewis12
98 GGUF models quantized by brittlewis12 on Hugging Face. Sizes run from 268M to 70.6B parameters. The longest trained context is 256K tokens.
About brittlewis12 on Hugging Face
brittlewis12 has published 98 GGUF models that ggufmodels.com tracks, across families such as Llama, Gemma and Mistral. The most downloaded are Kunoichi DPO v2 7B, Meta Llama 3.1 8B Instruct and Llama 3.2 1B Instruct Uncensored.
The quants brittlewis12 publishes most often are Q4_K_M (98), Q5_K_M (97), Q2_K (97) and Q6_K (96). Their Q4_K_M files range from 0.3 to 42.5 GB. Parameter counts run from 268M to 70.6B, and the longest trained context window is 256K tokens.
Frequently asked questions
What GGUF models has brittlewis12 published?
98 models are listed here, mainly from the Llama, Gemma and Mistral families. The most downloaded is Kunoichi DPO v2 7B.
Which quants does brittlewis12 publish?
The most common are Q4_K_M (98 models), Q5_K_M (97 models), Q2_K (97 models) and Q6_K (96 models).