GGUF models by forkjoin-ai

53 GGUF models quantized by forkjoin-ai on Hugging Face. Sizes run from 362M to 72.7B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 1b It
Gemma · forkjoin-ai
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
QW
Qwen3 32B Instruct
Qwen · forkjoin-ai
Params32.8B
Context40K
Smallest34.8 GB
ReasoningTool use
LL
Llama 3.2 1B Instruct
Llama · forkjoin-ai
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Meta-Llama-3-8B-Instruct
Llama · forkjoin-ai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 0.6B Instruct
Qwen · forkjoin-ai
Params596M
Context40K
Smallest0.6 GB
ReasoningTool use
LL
Llama 3.2 1B Instruct
Llama · forkjoin-ai
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
GE
Gemma 4 31b It Heretic Ara
Gemma · forkjoin-ai
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
QW
qwen2.5-3b-instruct
Qwen · forkjoin-ai
Params3.4B
Context32K
Q4_K_M2.1 GB
Tool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · forkjoin-ai
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · forkjoin-ai
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
LL
Llama 3.2 3B Instruct
Llama · forkjoin-ai
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Qwen2 VL 2B Instruct
Qwen · forkjoin-ai
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
MI
Mistral-7B-Instruct-v0.3
Mistral · forkjoin-ai
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
RW
rwkv7-2.9B-world
Rwkv · forkjoin-ai
Params2.95B
Context1024K
Q4_K_M1.9 GB
GGUF
YI
dolphin-2.9.1-yi-1.5-34b
Yi · forkjoin-ai
Params34.4B
Context8K
Q4_K_M20.7 GB
GGUF
GP
Gpt Oss 20b
gpt-oss · forkjoin-ai
Params20.9B
Context128K
Q4_K_M11.7 GB
Tool use
GE
Gemma 3 12b It
Gemma · forkjoin-ai
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
NE
Nemotron 3 Nano 30B A3B
Nemotron · forkjoin-ai
Params31.6B
Context1024K
Q4_K_M24.7 GB
ReasoningTool use
QW
Qwen3 VL 4B Instruct
Qwen · forkjoin-ai
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool useVision
QW
Qwen2 VL 7B Instruct
Qwen · forkjoin-ai
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision
QW
Qwen3 1.7B Instruct
Qwen · forkjoin-ai
Params1.72B
Context40K
Smallest1.8 GB
ReasoningTool use
GL
Glm 4 9b Chat
GLM · forkjoin-ai
Params9.4B
Context128K
Q4_K_M6.3 GB
Tool use
NA
nanbeige 3b
Nanbeige · forkjoin-ai
Params3.93B
Context192K
Q4_K_M2.4 GB
ReasoningTool use

Keep browsing