GGUF models by Biscotto58

35 GGUF models quantized by Biscotto58 on Hugging Face. Sizes run from 3.21B to 14.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 3B Instruct WriterV2 2E
Llama · Biscotto58
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MI
MistralNemoDionysus Narrator
Mistral · Biscotto58
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
MI
MistralNemoDionysus ID V2 DSlerp
Mistral · Biscotto58
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
QW
Qwen3 4B Instruct WriterV1 15E
Qwen · Biscotto58
Params4.02B
Context256K
Q4_K_M2.5 GB
ReasoningTool use
MI
MistralNemoDionysus
Mistral · Biscotto58
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF

Keep browsing