GGUF models by brittlewis12
98 GGUF models quantized by brittlewis12 on Hugging Face. Sizes run from 268M to 70.6B parameters. The longest trained context is 256K tokens.
PH
phi 2 orange
Phi · brittlewis12
Params2.78B
Context2K
Q4_K_M1.8 GB
AR
Maestro 7B Preview
Arcee · brittlewis12
Params7.61B
Context128K
Q4_K_M4.7 GB
ST
Starlette 1 3B
Starlette · brittlewis12
Params3.21B
Context128K
Q4_K_M2.0 GB
GE
Tiger Gemma 9B v2
Gemma · brittlewis12
Params9.24B
Context8K
Q4_K_M5.8 GB
ST
stable-code-instruct-3b
Stable · brittlewis12
Params2.8B
Context16K
Q4_K_M1.7 GB
LL
Hermes-2-Pro-Llama-3-8B
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
GO
gorilla openfunctions v2
Gorilla · brittlewis12
Params6.91B
Context4K
Q4_K_M4.2 GB
LL
Llama 3.2 3B Instruct
Llama · brittlewis12
Params3.21B
Context128K
Q4_K_M2.0 GB
OP
openchat 3.5 0106 11b
Openchat · brittlewis12
Params10.7B
Context32K
Q4_K_M6.5 GB
ST
starcoder2-3b-instruct
StarCoder · brittlewis12
Params3.03B
Context16K
Q4_K_M1.8 GB
LL
Hermes 3 Llama 3.1 8B
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
YI
Yi 9B 200K
Yi · brittlewis12
Params8.83B
Context256K
Q4_K_M5.3 GB
MI
TopicNeuralHermes 2.5 Mistral 7B
Mistral · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TinyOpenHermes 1.1B 4k
Tinyopenhermes · brittlewis12
Params1.1B
Context4K
Q4_K_M0.7 GB
MI
Hermes 2 Pro Mistral 7B
Mistral · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 9b It
Gemma · brittlewis12
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 2b It
Gemma · brittlewis12
Params2.61B
Context8K
Q4_K_M1.7 GB
NE
NeuralDaredevil 7B
Neuraldaredevil · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
meta llama 3 8b instruct hf ortho baukit 10fail 1000total
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
Yi Coder 9B Chat
Coder · brittlewis12
Params8.83B
Context128K
Q4_K_M5.3 GB
DA
H2O Danube3 4b Chat
Danube · brittlewis12
Params3.96B
Context8K
Q4_K_M2.4 GB
OC
Octopus-v2
Octopus · brittlewis12
Params2.51B
Context8K
Q4_K_M1.6 GB
OP
OpenCodeInterpreter DS 1.3B
Opencodeinterpreter · brittlewis12
Params1.35B
Context16K
Q4_K_M0.9 GB
QW
Qwen2-7B-Instruct
Qwen · brittlewis12
Params7.62B
Context32K
Q4_K_M4.7 GB
CO
code millenials 13b
Code · brittlewis12
Params13B
Context16K
Q4_K_M7.9 GB
QW
Qwen3.6 27B
Qwen · brittlewis12
Params27.3B
Context256K
Q4_K_M16.8 GB
ST
stablelm-2-1_6b-chat
Stablelm · brittlewis12
Params1.64B
Context4K
Q4_K_M1.0 GB
PH
phi 2 OpenHermes 2.5
Phi · brittlewis12
Params2.78B
Context2K
Q4_K_M1.7 GB
EM
Ember 7B v0.1
Ember · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral-7B-Instruct-v0.3
Mistral · brittlewis12
Params7.25B
Context32K
Q4_K_M4.4 GB