GGUF models by brittlewis12

98 GGUF models quantized by brittlewis12 on Hugging Face. Sizes run from 268M to 70.6B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2b Aps It
Gemma · brittlewis12
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
Llama 3.1 Storm 8B
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
S1
s1.1 32B
brittlewis12
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
BE
Beagle14 7B
Beagle · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Nemotron Mini 4B Instruct
Nemotron · brittlewis12
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
TW
TwinLlama 3.1 8B
Twinllama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
GE
gemma-7b
Gemma · brittlewis12
Params8.54B
Context8K
Q4_K_M5.1 GB
GGUF
GE
gemma-1.1-2b-it
Gemma · brittlewis12
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
ME
Memphis-CoT-3B
Memphis · brittlewis12
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
ST
stablelm-2-zephyr-1_6b
Stablelm · brittlewis12
Params1.64B
Context4K
Q4_K_M1.0 GB
GGUF
GE
Gemma 3 270M IT
Gemma · brittlewis12
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
QW
Qwen1.5-0.5B-OpenHermes-2.5
Qwen · brittlewis12
Params620M
Context32K
Q4_K_M0.4 GB
Tool use
DA
h2o danube 1.8b chat
Danube · brittlewis12
Params1.83B
Context16K
Q4_K_M1.1 GB
GGUF
MI
Mistral Small 24B Instruct 2501
Mistral · brittlewis12
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · brittlewis12
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
AA
aanaphi2 v0.1
Aanaphi · brittlewis12
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
LL
SFR Iterative DPO LLaMA 3 8B R
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Snorkel Mistral PairRM DPO
Mistral · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 3.5 Mini Instruct
Phi · brittlewis12
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
MA
magnum v2 4b
Magnum · brittlewis12
Params4.51B
Context128K
Q4_K_M2.8 GB
GGUF
ST
stablelm-zephyr-3b
Stablelm · brittlewis12
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
OP
OpenCodeInterpreter DS 6.7B
Opencodeinterpreter · brittlewis12
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
PH
Phiter
Phiter · brittlewis12
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
DI
distilabeled Marcoro14 7B slerp full
Distilabeled · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
starcoder2-3b
StarCoder · brittlewis12
Params3.03B
Context16K
Q4_K_M1.8 GB
Coding
CO
Yi Coder 1.5B Chat
Coder · brittlewis12
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
LL
dolphin 2.9 llama3 8b
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen1.5-1.8B-OpenHermes-2.5
Qwen · brittlewis12
Params1.84B
Context32K
Q4_K_M1.2 GB
Tool use
GE
gemma-1.1-7b-it
Gemma · brittlewis12
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
LL
Llama 3.3 70B Instruct
Llama · brittlewis12
Params70.6B
Context128K
Q4_K_M42.5 GB
Tool use

Keep browsing