GGUF models by Biscotto58
35 GGUF models quantized by Biscotto58 on Hugging Face. Sizes run from 3.21B to 14.8B parameters. The longest trained context is 1000K tokens.
LL
Llama 3.2 3B Instruct WriterV2 2E
Llama · Biscotto58
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
MistralNemoDionysus Narrator
Mistral · Biscotto58
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
MistralNemoDionysus ID V2 DSlerp
Mistral · Biscotto58
Params12.2B
Context128K
Q4_K_M7.5 GB
QW
Qwen3 4B Instruct WriterV1 15E
Qwen · Biscotto58
Params4.02B
Context256K
Q4_K_M2.5 GB
MI
MistralNemoDionysus
Mistral · Biscotto58
Params12.2B
Context128K
Q4_K_M7.5 GB