GGUF models by ClaudioItaly

172 GGUF models quantized by ClaudioItaly on Hugging Face. Sizes run from 51M to 32.8B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
Intelligence Cod Rag 7B V2 Q5 K M
Intelligence · ClaudioItaly
Params7.62B
Context32K
Smallest5.4 GB
GGUF
PA
Pandemonium V2 9B Q4 K M
Pandemonium · ClaudioItaly
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b It Peft Lora Merged
Gemma · ClaudioItaly
Params51M
Context—
Smallest0.2 GB
GGUF
EX
Exurbia Advance
Exurbia · ClaudioItaly
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen2.5 7B Gutenberg FT
Qwen · ClaudioItaly
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
KI
King 7B Q5 K M
King · ClaudioItaly
Params7.62B
Context32K
Smallest5.4 GB
GGUF
VA
Vangelus Poetic 9B Q4 K M
Vangelus · ClaudioItaly
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
IN
Intelligence Cod Rag 7B Q4 K M
Intelligence · ClaudioItaly
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3 8B Opc
Qwen · ClaudioItaly
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
NO
Noct 8B
Noct · ClaudioItaly
Params7.62B
Context128K
Smallest5.4 GB
GGUF
IN
Intelligence Cod Rag 7B Q6 K
Intelligence · ClaudioItaly
Params7.62B
Context32K
Smallest6.3 GB
GGUF
IN
intelligence cod rag 7b v3 Q8 0
Intelligence · ClaudioItaly
Params7.62B
Context32K
Smallest8.1 GB
GGUF
TO
Top11Evolution Q4 K M
Top · ClaudioItaly
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
IN
Intelligence Book v2 Q5 K M
Intelligence · ClaudioItaly
Params9.24B
Context8K
Smallest6.6 GB
GGUF
OR
OroSaiwa 12B Q4 K M
Orosaiwa · ClaudioItaly
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PR
Project 12 Q4 K M
Project · ClaudioItaly
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
PE
Perfect 7B Q4 K M
Perfect · ClaudioItaly
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
AN
Anya 9Y Q6 K
Anya · ClaudioItaly
Params9.24B
Context8K
Smallest7.6 GB
GGUF
WA
Wayfare Chronicles Gutenberg 12B Q4 K M
Wayfare · ClaudioItaly
Params10.1B
Context128K
Q4_K_M6.2 GB
GGUF
EV
Evolutionstory Q6 K
Evolutionstory · ClaudioItaly
Params7.24B
Context32K
Smallest5.9 GB
GGUF
SE
Sensorial V2 12B Q4 K M
Sensorial · ClaudioItaly
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
CL
Claustrophobia 9B Q5 K M
Claustrophobia · ClaudioItaly
Params9.24B
Context8K
Smallest6.6 GB
GGUF

Keep browsing