GGUF models by brittlewis12

98 GGUF models quantized by brittlewis12 on Hugging Face. Sizes run from 268M to 70.6B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
KU
Kunoichi DPO v2 7B
Kunoichi · brittlewis12
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Meta Llama 3.1 8B Instruct
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B Instruct Uncensored
Llama · brittlewis12
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
QwQ 32B
Qwen · brittlewis12
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
GE
Gemma 3 4B IT
Gemma · brittlewis12
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
LL
Llama 3.2 3B Instruct
Llama · brittlewis12
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · brittlewis12
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
LL
Meta Llama 3 8B Instruct
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 3 1B IT
Gemma · brittlewis12
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning
EU
Eurus 2 7B PRIME
Eurus · brittlewis12
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
RA
raspberry 3B
Raspberry · brittlewis12
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
Devstral Small 2507
Mistral · brittlewis12
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
LL
Llama 3.1 Tulu 3.1 8B
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ZE
zeta
Zeta · brittlewis12
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
DE
DeepSeek R1 0528 Qwen3 8B
DeepSeek · brittlewis12
Params8.19B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
MI
Mistral Small 24B Instruct 2501 reasoning
Mistral · brittlewis12
Params23.6B
Context32K
Q4_K_M14.3 GB
Reasoning
RE
Reka Flash 3
Reka · brittlewis12
Params20.9B
Context32K
Q4_K_M13.6 GB
Reasoning
ST
stable-code-3b
Stable · brittlewis12
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LL
DeepHermes 3 Llama 3 8B Preview
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GE
Gemma 3 27B IT
Gemma · brittlewis12
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
gemma-2b-it
Gemma · brittlewis12
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
Nemotron-Research-Reasoning-Qwen-1.5B
Qwen · brittlewis12
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
deepseek coder 7b instruct v1.5
DeepSeek · brittlewis12
Params6.91B
Context4K
Q4_K_M4.2 GB
Coding
GE
gemma-7b-it
Gemma · brittlewis12
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
OP
Open Reasoner Zero 7B
Open · brittlewis12
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · brittlewis12
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
GE
gemma-2b
Gemma · brittlewis12
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF
GL
GLM Z1 9B 0414
GLM · brittlewis12
Params9.4B
Context32K
Q4_K_M6.2 GB
Tool use
OL
OLMo 2 0425 1B Instruct
OLMo · brittlewis12
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · brittlewis12
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use

About brittlewis12 on Hugging Face

brittlewis12 has published 98 GGUF models that ggufmodels.com tracks, across families such as Llama, Gemma and Mistral. The most downloaded are Kunoichi DPO v2 7B, Meta Llama 3.1 8B Instruct and Llama 3.2 1B Instruct Uncensored.

The quants brittlewis12 publishes most often are Q4_K_M (98), Q5_K_M (97), Q2_K (97) and Q6_K (96). Their Q4_K_M files range from 0.3 to 42.5 GB. Parameter counts run from 268M to 70.6B, and the longest trained context window is 256K tokens.

Frequently asked questions

What GGUF models has brittlewis12 published?

98 models are listed here, mainly from the Llama, Gemma and Mistral families. The most downloaded is Kunoichi DPO v2 7B.

Which quants does brittlewis12 publish?

The most common are Q4_K_M (98 models), Q5_K_M (97 models), Q2_K (97 models) and Q6_K (96 models).

Keep browsing