GGUF models by smarttasks
36 GGUF models quantized by smarttasks on Hugging Face. Sizes run from 23M to 30.5B parameters. The longest trained context is 256K tokens.
MI
mistralai_Mistral 7B Instruct v0.3
Mistral · smarttasks
Params7.25B
Context32K
Q4_K_M4.4 GB
GE
Google_Gemma 2 9b It
Gemma · smarttasks
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
React Coder 7b
Qwen · smarttasks
Params7.62B
Context32K
Q4_K_M4.7 GB
VI
WeiboAI_VibeThinker 1.5B
Vibethinker · smarttasks
Params1.78B
Context128K
Q4_K_M1.1 GB
FA
tiiuae_Falcon3 7B Instruct
Falcon · smarttasks
Params7.46B
Context32K
Q4_K_M4.6 GB
MX
Mxbai Embed Large v1
Mxbai · smarttasks
Params334M
Context512
Q4_K_M0.2 GB