GGUF models by brittlewis12
98 GGUF models quantized by brittlewis12 on Hugging Face. Sizes run from 268M to 70.6B parameters. The longest trained context is 256K tokens.
GE
Gemma 2b Aps It
Gemma · brittlewis12
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
Llama 3.1 Storm 8B
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
S1
s1.1 32B
brittlewis12
Params32.8B
Context32K
Q4_K_M19.9 GB
BE
Beagle14 7B
Beagle · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nemotron Mini 4B Instruct
Nemotron · brittlewis12
Params4.19B
Context4K
Q4_K_M2.7 GB
TW
TwinLlama 3.1 8B
Twinllama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
GE
gemma-7b
Gemma · brittlewis12
Params8.54B
Context8K
Q4_K_M5.1 GB
GE
gemma-1.1-2b-it
Gemma · brittlewis12
Params2.51B
Context8K
Q4_K_M1.6 GB
ME
Memphis-CoT-3B
Memphis · brittlewis12
Params2.8B
Context4K
Q4_K_M1.7 GB
ST
stablelm-2-zephyr-1_6b
Stablelm · brittlewis12
Params1.64B
Context4K
Q4_K_M1.0 GB
GE
Gemma 3 270M IT
Gemma · brittlewis12
Params268M
Context32K
Q4_K_M0.3 GB
QW
Qwen1.5-0.5B-OpenHermes-2.5
Qwen · brittlewis12
Params620M
Context32K
Q4_K_M0.4 GB
DA
h2o danube 1.8b chat
Danube · brittlewis12
Params1.83B
Context16K
Q4_K_M1.1 GB
MI
Mistral Small 24B Instruct 2501
Mistral · brittlewis12
Params23.6B
Context32K
Q4_K_M14.3 GB
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · brittlewis12
Params1.78B
Context128K
Q4_K_M1.1 GB
AA
aanaphi2 v0.1
Aanaphi · brittlewis12
Params2.78B
Context2K
Q4_K_M1.7 GB
LL
SFR Iterative DPO LLaMA 3 8B R
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Snorkel Mistral PairRM DPO
Mistral · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Phi 3.5 Mini Instruct
Phi · brittlewis12
Params3.82B
Context128K
Q4_K_M2.4 GB
MA
magnum v2 4b
Magnum · brittlewis12
Params4.51B
Context128K
Q4_K_M2.8 GB
ST
stablelm-zephyr-3b
Stablelm · brittlewis12
Params2.8B
Context4K
Q4_K_M1.7 GB
OP
OpenCodeInterpreter DS 6.7B
Opencodeinterpreter · brittlewis12
Params6.74B
Context16K
Q4_K_M4.1 GB
PH
Phiter
Phiter · brittlewis12
Params2.78B
Context2K
Q4_K_M1.8 GB
DI
distilabeled Marcoro14 7B slerp full
Distilabeled · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
starcoder2-3b
StarCoder · brittlewis12
Params3.03B
Context16K
Q4_K_M1.8 GB
CO
Yi Coder 1.5B Chat
Coder · brittlewis12
Params1.48B
Context128K
Q4_K_M1.0 GB
LL
dolphin 2.9 llama3 8b
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen1.5-1.8B-OpenHermes-2.5
Qwen · brittlewis12
Params1.84B
Context32K
Q4_K_M1.2 GB
GE
gemma-1.1-7b-it
Gemma · brittlewis12
Params8.54B
Context8K
Q4_K_M5.3 GB
LL
Llama 3.3 70B Instruct
Llama · brittlewis12
Params70.6B
Context128K
Q4_K_M42.5 GB