GGUF models by Melvin56
62 GGUF models quantized by Melvin56 on Hugging Face. Sizes run from 494M to 10.3B parameters. The longest trained context is 128K tokens.
LL
Nidum Llama 3.2 3B Uncensored
Llama · Melvin56
Params3.21B
Context128K
Smallest1.8 GB
HA
Hammer2.1 1.5b
Hammer · Melvin56
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5 7B Instruct Abliterated v3
Qwen · Melvin56
Params7.62B
Context32K
Smallest4.4 GB
LL
Hermes 3 Llama 3.2 3B
Llama · Melvin56
Params3.21B
Context128K
Smallest3.4 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · Melvin56
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Nidum Llama 3.2 3B Uncensored
Llama · Melvin56
Params3.21B
Context128K
Smallest3.4 GB
MI
MicroThinker 3B Preview
Microthinker · Melvin56
Params3.21B
Context128K
Smallest3.4 GB
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Melvin56
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
MicroThinker 1B Preview
Microthinker · Melvin56
Params1.24B
Context128K
Smallest1.3 GB
QW
Qwen2.5 0.5B
Qwen · Melvin56
Params494M
Context32K
Q4_K_M0.4 GB
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Melvin56
Params3.21B
Context128K
Smallest3.4 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Melvin56
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 7B Instruct Abliterated v3
Qwen · Melvin56
Params7.62B
Context32K
Smallest4.2 GB
QW
EVA Qwen2.5 1.5B v0.0
Qwen · Melvin56
Params1.54B
Context128K
Smallest0.9 GB
FA
Falcon3 7B Instruct Abliterated
Falcon · Melvin56
Params7.46B
Context32K
Smallest2.9 GB
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Melvin56
Params3.21B
Context128K
Smallest1.8 GB
EX
EXAONE 3.5 2.4B Instruct
Exaone · Melvin56
Params2.67B
Context32K
Smallest1.5 GB
QW
Qwen2.5 0.5B
Qwen · Melvin56
Params494M
Context32K
Smallest0.5 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · Melvin56
Params1.54B
Context4K
Smallest0.9 GB
QW
Rombo LLM V2.5 Qwen 3b
Qwen · Melvin56
Params3.4B
Context32K
Q4_K_M2.1 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · Melvin56
Params1.54B
Context4K
Q4_K_M1.0 GB
FA
Falcon3 10B Instruct Abliterated
Falcon · Melvin56
Params10.3B
Context32K
Smallest3.9 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · Melvin56
Params1.54B
Context4K
Smallest1.6 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Melvin56
Params3.09B
Context32K
Smallest3.3 GB
MI
MicroThinker 3B Preview
Microthinker · Melvin56
Params3.21B
Context128K
Smallest1.9 GB
QW
EVA Qwen2.5 1.5B v0.0
Qwen · Melvin56
Params1.54B
Context128K
Smallest1.6 GB
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Melvin56
Params3.09B
Context32K
Smallest1.3 GB
EX
EXAONE 3.5 2.4B Instruct
Exaone · Melvin56
Params2.67B
Context32K
Smallest1.1 GB
EX
EXAONE 3.5 7.8B Instruct Abliterated
Exaone · Melvin56
Params7.82B
Context32K
Smallest4.3 GB
EX
EXAONE 3.5 2.4B Instruct
Exaone · Melvin56
Params2.67B
Context32K
Smallest2.8 GB