GGUF models by HappyAIUser
40 GGUF models quantized by HappyAIUser on Hugging Face. Sizes run from 1.24B to 14.8B parameters. The longest trained context is 1000K tokens.
MI
MathGPT Mistral Nemo Merged
Mistral · HappyAIUser
Params12.2B
Context1000K
Smallest13.0 GB
SU
Sussysysysyusd GGUF F16
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Smallest6.4 GB
AT
AtmasiddhiGPTv21
Atmasiddhigptv · HappyAIUser
Params4.02B
Context40K
Smallest8.1 GB
SU
Sussysysysyusd GGUF Q2 K
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Smallest1.4 GB
SU
Sussysysysyusd GGUF Q3 K M
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Smallest1.7 GB
SU
Sussysysysyusd GGUF Q5 K M
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Smallest2.3 GB
SU
Sussysysysyusd GGUF Q4 K M
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Q4_K_M2.0 GB
MO
modelname
Modelname · HappyAIUser
Params3.21B
Context128K
Smallest3.4 GB
SU
Sussysysysyusd GGUF Q8 0
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Smallest3.4 GB
SU
sususususususus
Sususususususus · HappyAIUser
Params3.21B
Context128K
Q4_K_M2.0 GB