GGUF models by brittlewis12

98 GGUF models quantized by brittlewis12 on Hugging Face. Sizes run from 268M to 70.6B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
phi 2 orange
Phi · brittlewis12
Params2.78B
Context2K
Q4_K_M1.8 GB
GGUF
AR
Maestro 7B Preview
Arcee · brittlewis12
Params7.61B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
ST
Starlette 1 3B
Starlette · brittlewis12
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningTool use
GE
Tiger Gemma 9B v2
Gemma · brittlewis12
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ST
stable-code-instruct-3b
Stable · brittlewis12
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
LL
Hermes-2-Pro-Llama-3-8B
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
GO
gorilla openfunctions v2
Gorilla · brittlewis12
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · brittlewis12
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
OP
openchat 3.5 0106 11b
Openchat · brittlewis12
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
ST
starcoder2-3b-instruct
StarCoder · brittlewis12
Params3.03B
Context16K
Q4_K_M1.8 GB
Coding
LL
Hermes 3 Llama 3.1 8B
Llama · brittlewis12
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
YI
Yi 9B 200K
Yi · brittlewis12
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
MI
TopicNeuralHermes 2.5 Mistral 7B
Mistral · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
TI
TinyOpenHermes 1.1B 4k
Tinyopenhermes · brittlewis12
Params1.1B
Context4K
Q4_K_M0.7 GB
Tool use
MI
Hermes 2 Pro Mistral 7B
Mistral · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
GE
Gemma 2 9b It
Gemma · brittlewis12
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b It
Gemma · brittlewis12
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
NE
NeuralDaredevil 7B
Neuraldaredevil · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
meta llama 3 8b instruct hf ortho baukit 10fail 1000total
Llama · brittlewis12
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
Yi Coder 9B Chat
Coder · brittlewis12
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
DA
H2O Danube3 4b Chat
Danube · brittlewis12
Params3.96B
Context8K
Q4_K_M2.4 GB
GGUF
OC
Octopus-v2
Octopus · brittlewis12
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
OP
OpenCodeInterpreter DS 1.3B
Opencodeinterpreter · brittlewis12
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
QW
Qwen2-7B-Instruct
Qwen · brittlewis12
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
CO
code millenials 13b
Code · brittlewis12
Params13B
Context16K
Q4_K_M7.9 GB
Coding
QW
Qwen3.6 27B
Qwen · brittlewis12
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
ST
stablelm-2-1_6b-chat
Stablelm · brittlewis12
Params1.64B
Context4K
Q4_K_M1.0 GB
GGUF
PH
phi 2 OpenHermes 2.5
Phi · brittlewis12
Params2.78B
Context2K
Q4_K_M1.7 GB
Tool use
EM
Ember 7B v0.1
Ember · brittlewis12
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral-7B-Instruct-v0.3
Mistral · brittlewis12
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing