GGUF models by Jackrong
66 GGUF models quantized by Jackrong on Hugging Face. Sizes run from 334M to 35B parameters. The longest trained context is 256K tokens.
QW
Qwopus3.6 27B Fusion BF16
Qwen · Jackrong
Params27.3B
Context256K
Smallest54.7 GB
LL
Llama3.1 8B Thinking R1
Llama · Jackrong
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Elite
Llama · Jackrong
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
llama 3.2 3B Elite
Llama · Jackrong
Params3.21B
Context128K
Smallest3.4 GB
LL
llama 3.2 3B Chinese Elite
Llama · Jackrong
Params3.21B
Context128K
Smallest3.4 GB
LL
Llama 3.1 8B Instruct Chinese Elite
Llama · Jackrong
Params8.03B
Context128K
Q4_K_M4.9 GB