GGUF models by ClaudioItaly

172 GGUF models quantized by ClaudioItaly on Hugging Face. Sizes run from 51M to 32.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Hermes 3 Llama 3.1 8B
Llama · ClaudioItaly
Params8.03B
Context128K
Smallest5.7 GB
RoleplayTool use
QW
Qwen2.5 Coder 7B Instruct
Qwen · ClaudioItaly
Params7.62B
Context32K
Smallest5.4 GB
CodingTool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · ClaudioItaly
Params7.62B
Context128K
Smallest5.4 GB
ReasoningTool use
AL
Albacus V2 Imatrix
Albacus · ClaudioItaly
Params8.99B
Context32K
Smallest6.4 GB
GGUF
TO
TopEvolution
Topevolutionwiz · ClaudioItaly
Params7.24B
Context32K
Smallest5.1 GB
GGUF
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · ClaudioItaly
Params10.7B
Context16K
Q4_K_M6.5 GB
GGUF
FI
Fimbulvetr 11B Imatrix
Fimbulvetr · ClaudioItaly
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
ME
Memory 9 Q4 K M
Memory · ClaudioItaly
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Meta Llama 3.1 8B Claude bf16 Q5 K M
Llama · ClaudioItaly
Params8.03B
Context128K
Smallest5.7 GB
Tool use
LL
Reflection Llama 3.1 8B Q5 K M
Llama · ClaudioItaly
Params8.03B
Context128K
Smallest5.7 GB
GGUF
FI
Fimbulvetr 40 Q4 K M
Fimbulvetr · ClaudioItaly
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
QW
Qwen2.5 Coder 32B
Qwen · ClaudioItaly
Params32.8B
Context32K
Smallest15.9 GB
CodingTool use
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · ClaudioItaly
Params10.7B
Context16K
Smallest6.1 GB
GGUF
EV
EvolutionFimbMoister 11 Q4 K M
Evolutionfimbmoister · ClaudioItaly
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
MI
Superevolution
Mistral · ClaudioItaly
Params7.24B
Context32K
Smallest5.1 GB
Tool use
KU
mergekit slerp ebgdloh Q4 K M
Kunoichi · ClaudioItaly
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TO
TopEvolution-DPO-32K
Topevolution · ClaudioItaly
Params7.24B
Context32K
Smallest5.1 GB
GGUF
UT
Utopia Range Q4 K M
Utopia · ClaudioItaly
Params12.7B
Context4K
Q4_K_M7.7 GB
GGUF
MI
TopEvolution
Mistral · ClaudioItaly
Params7.24B
Context32K
Smallest7.7 GB
Tool use
QW
Cpdc Rl Qwen3 8b Roleplay 0626 200steps Yitian
Qwen · ClaudioItaly
Params8.19B
Context40K
Q4_K_M5.0 GB
Roleplay
QW
QwenTies 14B Q3 K M
Qwen · ClaudioItaly
Params14.8B
Context32K
Smallest7.3 GB
Tool use
QW
QwenPaw Flash 4B
Qwen · ClaudioItaly
Params4.84B
Context256K
Smallest4.0 GB
GGUF
NO
Topsecret
Nous · ClaudioItaly
Params4.62B
Context32K
Smallest3.2 GB
Tool use
VI
Vikhr Nemo 12B Instruct R 21 09 24 Q4 K M
Vikhr · ClaudioItaly
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
FI
Fimbulvetr Cognitive 11B V3 Q5 K M
Fimbulvetr · ClaudioItaly
Params10.5B
Context4K
Smallest7.4 GB
GGUF
TO
TopEvolutionWiz
Topevolutionwiz · ClaudioItaly
Params7.24B
Context32K
Smallest5.9 GB
GGUF
EX
Exper Alfa V1 Q4 K M
Exper · ClaudioItaly
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
KU
mergekit-slerp-ebgdloh
Kunoichi · ClaudioItaly
Params7.24B
Context32K
Smallest7.7 GB
GGUF
LA
Lama Evocation
Lama · ClaudioItaly
Params8.03B
Context8K
Smallest8.5 GB
GGUF
MI
Mistroll-7B-v2.2
Mistroll · ClaudioItaly
Params7.24B
Context32K
Smallest5.9 GB
GGUF

About ClaudioItaly on Hugging Face

ClaudioItaly has published 172 GGUF models that ggufmodels.com tracks, across families such as Qwen, Intelligence and Evolutionstory. The most downloaded are Hermes 3 Llama 3.1 8B, Qwen2.5 Coder 7B Instruct and DeepSeek R1 Distill Qwen 7B.

The quants ClaudioItaly publishes most often are Q4_K_M (80), Q5_K_M (50), Q6_K (19) and Q8_0 (9). Their Q4_K_M files range from 4.1 to 9.0 GB. Parameter counts run from 51M to 32.8B, and the longest trained context window is 1000K tokens.

Frequently asked questions

What GGUF models has ClaudioItaly published?

172 models are listed here, mainly from the Qwen, Intelligence and Evolutionstory families. The most downloaded is Hermes 3 Llama 3.1 8B.

Which quants does ClaudioItaly publish?

The most common are Q4_K_M (80 models), Q5_K_M (50 models), Q6_K (19 models) and Q8_0 (9 models).

Keep browsing