GGUF models by HappyAIUser

40 GGUF models quantized by HappyAIUser on Hugging Face. Sizes run from 1.24B to 14.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MathGPT Mistral Nemo Merged
Mistral · HappyAIUser
Params12.2B
Context1000K
Smallest13.0 GB
Tool use
SU
Sussysysysyusd GGUF F16
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Smallest6.4 GB
Tool use
AT
AtmasiddhiGPTv21
Atmasiddhigptv · HappyAIUser
Params4.02B
Context40K
Smallest8.1 GB
ReasoningTool use
SU
Sussysysysyusd GGUF Q2 K
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Smallest1.4 GB
Tool use
SU
Sussysysysyusd GGUF Q3 K M
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Smallest1.7 GB
Tool use
SU
Sussysysysyusd GGUF Q5 K M
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Smallest2.3 GB
Tool use
SU
Sussysysysyusd GGUF Q4 K M
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MO
modelname
Modelname · HappyAIUser
Params3.21B
Context128K
Smallest3.4 GB
Tool use
SU
Sussysysysyusd GGUF Q8 0
Sussysysysyusd · HappyAIUser
Params3.21B
Context128K
Smallest3.4 GB
Tool use
SU
sususususususus
Sususususususus · HappyAIUser
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Keep browsing