GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
Models CohereForAI C4Ai Command A 03 2025
Command R · MaziyarPanahi
Params111B
Context16K
Q4_K_M67.1 GB
Tool use
DE
Models Deepseek Ai DeepSeek V2.5
DeepSeek · MaziyarPanahi
Params236B
Context160K
Q4_K_M142.5 GB
Tool use
EX
models--automerger--Experiment26Alloyingotneoy-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
ChatMusician
Chatmusician · MaziyarPanahi
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
ST
Starling LM 7B alpha
Starling · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
CA
models--mergekit-community--mergekit-dare_ties-ymiqjtz
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Models Qwen Qwen2 Math 1.5B Instruct
Qwen · MaziyarPanahi
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
NE
models--automerger--AlloyingotneoyNeuralsirkrishna-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.6 mistral 7b
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MI
openbuddy zephyr 7b v14.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--YamExperiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CH
Chocolatine 3B Instruct DPO v1.2
Chocolatine · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
MI
Mistral 7B claude instruct Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.6 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
calme 2.7 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
calme 2.1 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
MI
japanese stablelm instruct gamma 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b sft full Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Llama 3.1 Nemotron 70B Instruct HF
Mistral · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M13.3 GB
Tool use
MI
Synatra V0.1 7B Instruct Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
models--automerger--PasticheAlloyingotneoy-7B
Pastiche · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral ft optimized 1218
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
models--automerger--NeuralsirkrishnaM7-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--MaziyarPanahi--Llama-3-70B-Instruct-32k-v0.1
Llama · MaziyarPanahi
Params70.6B
Context31K
Q4_K_M42.5 GB
GGUF
LL
CodeLlama 34b Python hf
Llama · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
QW
Models Huihui Ai Qwen2.5 7B Instruct Abliterated v2
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
MO
models--automerger--T3qm7xNeuralsirkrishna-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
deepseek math 7b instruct
DeepSeek · MaziyarPanahi
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
TO
models--mergekit-community--TopEvolutionWiz
Topevolution · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment28M7-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing