GGUF models by Melvin56

62 GGUF models quantized by Melvin56 on Hugging Face. Sizes run from 494M to 10.3B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Nidum Llama 3.2 3B Uncensored
Llama · Melvin56
Params3.21B
Context128K
Smallest1.8 GB
CodingTool use
HA
Hammer2.1 1.5b
Hammer · Melvin56
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
QW
Qwen2.5 7B Instruct Abliterated v3
Qwen · Melvin56
Params7.62B
Context32K
Smallest4.4 GB
Tool use
LL
Hermes 3 Llama 3.2 3B
Llama · Melvin56
Params3.21B
Context128K
Smallest3.4 GB
RoleplayTool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · Melvin56
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
LL
Nidum Llama 3.2 3B Uncensored
Llama · Melvin56
Params3.21B
Context128K
Smallest3.4 GB
CodingTool use
MI
MicroThinker 3B Preview
Microthinker · Melvin56
Params3.21B
Context128K
Smallest3.4 GB
ReasoningTool use
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Melvin56
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
MI
MicroThinker 1B Preview
Microthinker · Melvin56
Params1.24B
Context128K
Smallest1.3 GB
ReasoningTool use
QW
Qwen2.5 0.5B
Qwen · Melvin56
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Melvin56
Params3.21B
Context128K
Smallest3.4 GB
CodingTool use
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Melvin56
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
QW
Qwen2.5 7B Instruct Abliterated v3
Qwen · Melvin56
Params7.62B
Context32K
Smallest4.2 GB
Tool use
QW
EVA Qwen2.5 1.5B v0.0
Qwen · Melvin56
Params1.54B
Context128K
Smallest0.9 GB
Roleplay
FA
Falcon3 7B Instruct Abliterated
Falcon · Melvin56
Params7.46B
Context32K
Smallest2.9 GB
Tool use
LL
Dolphin 3.0 Llama 3.2 3B
Llama · Melvin56
Params3.21B
Context128K
Smallest1.8 GB
CodingTool use
EX
EXAONE 3.5 2.4B Instruct
Exaone · Melvin56
Params2.67B
Context32K
Smallest1.5 GB
GGUF
QW
Qwen2.5 0.5B
Qwen · Melvin56
Params494M
Context32K
Smallest0.5 GB
CodingTool use
QW
Qwen2.5 Math 1.5B Instruct
Qwen · Melvin56
Params1.54B
Context4K
Smallest0.9 GB
Tool use
QW
Rombo LLM V2.5 Qwen 3b
Qwen · Melvin56
Params3.4B
Context32K
Q4_K_M2.1 GB
Tool use
QW
Qwen2.5 Math 1.5B Instruct
Qwen · Melvin56
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
FA
Falcon3 10B Instruct Abliterated
Falcon · Melvin56
Params10.3B
Context32K
Smallest3.9 GB
Tool use
QW
Qwen2.5 Math 1.5B Instruct
Qwen · Melvin56
Params1.54B
Context4K
Smallest1.6 GB
Tool use
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Melvin56
Params3.09B
Context32K
Smallest3.3 GB
CodingTool use
MI
MicroThinker 3B Preview
Microthinker · Melvin56
Params3.21B
Context128K
Smallest1.9 GB
ReasoningTool use
QW
EVA Qwen2.5 1.5B v0.0
Qwen · Melvin56
Params1.54B
Context128K
Smallest1.6 GB
Roleplay
QW
Dolphin3.0 Qwen2.5 3B
Qwen · Melvin56
Params3.09B
Context32K
Smallest1.3 GB
CodingTool use
EX
EXAONE 3.5 2.4B Instruct
Exaone · Melvin56
Params2.67B
Context32K
Smallest1.1 GB
GGUF
EX
EXAONE 3.5 7.8B Instruct Abliterated
Exaone · Melvin56
Params7.82B
Context32K
Smallest4.3 GB
GGUF
EX
EXAONE 3.5 2.4B Instruct
Exaone · Melvin56
Params2.67B
Context32K
Smallest2.8 GB
GGUF

Keep browsing