GGUF models by Agnuxo

93 GGUF models quantized by Agnuxo on Hugging Face. Sizes run from 4M to 12.2B parameters. The longest trained context is 1000K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Agente Director Qwen2 7B Instruct CODE Python Spanish English GGUF q5 k
Qwen · Agnuxo
Params7.62B
Context32K
Smallest5.4 GB
Coding
QW
Agente Director Qwen2 7B Instruct CODE Python GGUF Spanish English 8bit
Qwen · Agnuxo
Params7.62B
Context32K
Smallest8.1 GB
Coding
PH
Phi 3.5 mini instruct python coding assistant GGUF 8bit
Phi · Agnuxo
Params3.82B
Context128K
Smallest4.1 GB
Coding
QW
Agente GPT Qwen 2.5 7B GGUF 16bit
Qwen · Agnuxo
Params7.62B
Context128K
Smallest15.2 GB
Tool use
MI
Mamba Codestral 7B v0.1 instruct python coding assistant GGUF 16bit
Mistral · Agnuxo
Params7.25B
Context32K
Smallest14.5 GB
Coding
MI
Mamba Codestral 7B Instruct CODE Python Spanish English GGUF 16bit
Mistral · Agnuxo
Params7.25B
Context32K
Smallest14.5 GB
Coding
QW
Agente GPT Qwen 2.5 7B Spanish English GGUF 32bit
Qwen · Agnuxo
Params7.62B
Context128K
Smallest30.5 GB
Tool use
LL
Llama 3.1 Minitron 4B Instruct CODE Python Spanish English GGUF 4bit
Llama · Agnuxo
Params4.54B
Context128K
Q4_K_M2.8 GB
Coding
LL
Agente Llama 3.1 Spanish English GGUF q6 k
Llama · Agnuxo
Params8.03B
Context128K
Smallest6.6 GB
GGUF
QW
Qwen2 7B v2 Instruct CODE Python Spanish English GGUF 4bit
Qwen · Agnuxo
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Agente GPT Qwen 2.5 7B Spanish English GGUF q5 k
Qwen · Agnuxo
Params7.62B
Context128K
Smallest5.4 GB
Tool use
QW
Qwen2 1.5B Instruct MOE assistant GGUF 4bit
Qwen · Agnuxo
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen2 1.5B Instruct MOE BIOLOGY assistant GGUF 16bit
Qwen · Agnuxo
Params1.54B
Context32K
Smallest3.1 GB
GGUF
QW
Agente GPT Qwen 2.5 7B Spanish English GGUF 4bit
Qwen · Agnuxo
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
QW
Qwen2 7B Instruct CODE Python Spanish English GGUF 4bit
Qwen · Agnuxo
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
LL
Agente Llama 3.1 Spanish English GGUF q5 k
Llama · Agnuxo
Params8.03B
Context128K
Smallest5.7 GB
GGUF
QW
Qwen2 1.5B Instruct MOE BIOLOGY assistant GGUF 8bit
Qwen · Agnuxo
Params1.54B
Context32K
Smallest1.6 GB
GGUF
TI
Tinytron ORCA 3B TinyLlama Instruct CODE Python extra small quantization GGUF 3bit
Tinytron · Agnuxo
Params1.1B
Context2K
Smallest2.2 GB
Coding
TI
Tinytron ORCA 7B Instruct CODE Python Spanish English GGUF 4bit
Tinytron · Agnuxo
Params6.74B
Context4K
Q4_K_M4.1 GB
Coding
TI
Tinytron ORCA 7B Instruct CODE Python English GGUF 16bit
Tinytron · Agnuxo
Params6.74B
Context4K
Smallest13.5 GB
Coding
QW
Qwen2 7B v2 Instruct CODE Python Spanish English GGUF 32bit
Qwen · Agnuxo
Params7.62B
Context32K
Smallest30.5 GB
Coding
GE
gemma 2 2b Python CODE assistant GGUF 8bit
Gemma · Agnuxo
Params2.61B
Context8K
Smallest2.8 GB
Coding
QW
Qwen2 1.5B Instruct MOE CODE assistant GGUF 16bit
Qwen · Agnuxo
Params1.54B
Context32K
Smallest3.1 GB
Coding
QW
Qwen2_0.5B Spanish_English_raspberry_pi_GGUF_4bit
Qwen · Agnuxo
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
QW
Qwen2 7B Instruct CODE Python Spanish English GGUF 16bit
Qwen · Agnuxo
Params7.62B
Context32K
Smallest15.2 GB
Coding
QW
Qwen2 1.5B Instruct MOE assistant GGUF 8bit
Qwen · Agnuxo
Params1.54B
Context32K
Smallest1.6 GB
GGUF
LL
Agente Llama 3.1 Spanish English GGUF 32bit
Llama · Agnuxo
Params8.03B
Context128K
Smallest32.1 GB
GGUF
MI
Mamba Codestral 7B Instruct CODE Python GGUF Spanish English 8bit
Mistral · Agnuxo
Params7.25B
Context32K
Smallest7.7 GB
Coding
TI
Tinytron 1B TinyLlama Instruct CODE Python Spanish English GGUF q5 k
Tinytron · Agnuxo
Params1.1B
Context2K
Smallest0.8 GB
Coding
QW
Qwen2 7B v2 Instruct CODE Python Spanish English GGUF 16bit
Qwen · Agnuxo
Params7.62B
Context32K
Smallest15.2 GB
Coding

Keep browsing