GGUF models by Jackrong

66 GGUF models quantized by Jackrong on Hugging Face. Sizes run from 334M to 35B parameters. The longest trained context is 256K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwopus3.6 27B Fusion BF16
Qwen · Jackrong
Params27.3B
Context256K
Smallest54.7 GB
CodingReasoningTool use
LL
Llama3.1 8B Thinking R1
Llama · Jackrong
Params8.03B
Context128K
Q4_K_M4.9 GB
Reasoning
LL
Llama 3.1 8B Instruct Elite
Llama · Jackrong
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
LL
llama 3.2 3B Elite
Llama · Jackrong
Params3.21B
Context128K
Smallest3.4 GB
Tool use
LL
llama 3.2 3B Chinese Elite
Llama · Jackrong
Params3.21B
Context128K
Smallest3.4 GB
Tool use
LL
Llama 3.1 8B Instruct Chinese Elite
Llama · Jackrong
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing