GGUF models by smarttasks

36 GGUF models quantized by smarttasks on Hugging Face. Sizes run from 23M to 30.5B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
mistralai_Mistral 7B Instruct v0.3
Mistral · smarttasks
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use
GE
Google_Gemma 2 9b It
Gemma · smarttasks
Params9.24B
Context8K
Q4_K_M5.8 GB
Tool use
QW
React Coder 7b
Qwen · smarttasks
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
VI
WeiboAI_VibeThinker 1.5B
Vibethinker · smarttasks
Params1.78B
Context128K
Q4_K_M1.1 GB
Tool use
FA
tiiuae_Falcon3 7B Instruct
Falcon · smarttasks
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
MX
Mxbai Embed Large v1
Mxbai · smarttasks
Params334M
Context512
Q4_K_M0.2 GB
Embedding

Keep browsing