GGUF models by Agnuxo
93 GGUF models quantized by Agnuxo on Hugging Face. Sizes run from 4M to 12.2B parameters. The longest trained context is 1000K tokens.
QW
Agente Director Qwen2 7B Instruct CODE Python Spanish English GGUF q5 k
Qwen · Agnuxo
Params7.62B
Context32K
Smallest5.4 GB
QW
Agente Director Qwen2 7B Instruct CODE Python GGUF Spanish English 8bit
Qwen · Agnuxo
Params7.62B
Context32K
Smallest8.1 GB
PH
Phi 3.5 mini instruct python coding assistant GGUF 8bit
Phi · Agnuxo
Params3.82B
Context128K
Smallest4.1 GB
QW
Agente GPT Qwen 2.5 7B GGUF 16bit
Qwen · Agnuxo
Params7.62B
Context128K
Smallest15.2 GB
MI
Mamba Codestral 7B v0.1 instruct python coding assistant GGUF 16bit
Mistral · Agnuxo
Params7.25B
Context32K
Smallest14.5 GB
MI
Mamba Codestral 7B Instruct CODE Python Spanish English GGUF 16bit
Mistral · Agnuxo
Params7.25B
Context32K
Smallest14.5 GB
QW
Agente GPT Qwen 2.5 7B Spanish English GGUF 32bit
Qwen · Agnuxo
Params7.62B
Context128K
Smallest30.5 GB
LL
Llama 3.1 Minitron 4B Instruct CODE Python Spanish English GGUF 4bit
Llama · Agnuxo
Params4.54B
Context128K
Q4_K_M2.8 GB
LL
Agente Llama 3.1 Spanish English GGUF q6 k
Llama · Agnuxo
Params8.03B
Context128K
Smallest6.6 GB
QW
Qwen2 7B v2 Instruct CODE Python Spanish English GGUF 4bit
Qwen · Agnuxo
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Agente GPT Qwen 2.5 7B Spanish English GGUF q5 k
Qwen · Agnuxo
Params7.62B
Context128K
Smallest5.4 GB
QW
Qwen2 1.5B Instruct MOE assistant GGUF 4bit
Qwen · Agnuxo
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2 1.5B Instruct MOE BIOLOGY assistant GGUF 16bit
Qwen · Agnuxo
Params1.54B
Context32K
Smallest3.1 GB
QW
Agente GPT Qwen 2.5 7B Spanish English GGUF 4bit
Qwen · Agnuxo
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen2 7B Instruct CODE Python Spanish English GGUF 4bit
Qwen · Agnuxo
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Agente Llama 3.1 Spanish English GGUF q5 k
Llama · Agnuxo
Params8.03B
Context128K
Smallest5.7 GB
QW
Qwen2 1.5B Instruct MOE BIOLOGY assistant GGUF 8bit
Qwen · Agnuxo
Params1.54B
Context32K
Smallest1.6 GB
TI
Tinytron ORCA 3B TinyLlama Instruct CODE Python extra small quantization GGUF 3bit
Tinytron · Agnuxo
Params1.1B
Context2K
Smallest2.2 GB
TI
Tinytron ORCA 7B Instruct CODE Python Spanish English GGUF 4bit
Tinytron · Agnuxo
Params6.74B
Context4K
Q4_K_M4.1 GB
TI
Tinytron ORCA 7B Instruct CODE Python English GGUF 16bit
Tinytron · Agnuxo
Params6.74B
Context4K
Smallest13.5 GB
QW
Qwen2 7B v2 Instruct CODE Python Spanish English GGUF 32bit
Qwen · Agnuxo
Params7.62B
Context32K
Smallest30.5 GB
GE
gemma 2 2b Python CODE assistant GGUF 8bit
Gemma · Agnuxo
Params2.61B
Context8K
Smallest2.8 GB
QW
Qwen2 1.5B Instruct MOE CODE assistant GGUF 16bit
Qwen · Agnuxo
Params1.54B
Context32K
Smallest3.1 GB
QW
Qwen2_0.5B Spanish_English_raspberry_pi_GGUF_4bit
Qwen · Agnuxo
Params494M
Context128K
Q4_K_M0.4 GB
QW
Qwen2 7B Instruct CODE Python Spanish English GGUF 16bit
Qwen · Agnuxo
Params7.62B
Context32K
Smallest15.2 GB
QW
Qwen2 1.5B Instruct MOE assistant GGUF 8bit
Qwen · Agnuxo
Params1.54B
Context32K
Smallest1.6 GB
LL
Agente Llama 3.1 Spanish English GGUF 32bit
Llama · Agnuxo
Params8.03B
Context128K
Smallest32.1 GB
MI
Mamba Codestral 7B Instruct CODE Python GGUF Spanish English 8bit
Mistral · Agnuxo
Params7.25B
Context32K
Smallest7.7 GB
TI
Tinytron 1B TinyLlama Instruct CODE Python Spanish English GGUF q5 k
Tinytron · Agnuxo
Params1.1B
Context2K
Smallest0.8 GB
QW
Qwen2 7B v2 Instruct CODE Python Spanish English GGUF 16bit
Qwen · Agnuxo
Params7.62B
Context32K
Smallest15.2 GB