GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
OR
models--mergekit-community--mergekit-ties-polycrr
Orca · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
EX
Models LGAI EXAONE EXAONE 3.5 2.4B Instruct
Exaone · MaziyarPanahi
Params2.41B
Context32K
Q4_K_M1.5 GB
GGUF
BI
BioMistral Clinical 7B
Biomistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
LL
Models Hiyouga Qwen 14B Chat LLaMAfied
Llama · MaziyarPanahi
Params14.2B
Context8K
Smallest10.0 GB
GGUF
MI
MISCHIEVOUS 12B Mix 0.4v
Mischievous · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
NE
Models Nvidia NVIDIA Nemotron Nano 9B v2
Nemotron · MaziyarPanahi
Params8.89B
Context1024K
Q4_K_M6.5 GB
ReasoningTool use
AY
Ayla Light 12B
Ayla · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
MI
mistral 7b v5 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Models Deepcogito Cogito v1 Preview Llama 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
IN
models--automerger--Inex12Neural-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
Metis 0.4
Metis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment27Inex12-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Captain BMO 0.420 Magnum 12B
Captain · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
OP
openthaigpt1.5 7b instruct
Openthaigpt · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
MI
Mistral Nemo Kurdish Instruct
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
LA
Models prithivMLmods Lacerta Opus 14B Elite8
Lacerta · MaziyarPanahi
Params14.8B
Context986K
Smallest10.3 GB
Tool use
QW
Models Qwen Qwen2.5 Coder 14B
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
CodingTool use
LL
Models prithivMLmods DeepHermes 3 Llama 3 3B Preview Abliterated
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Tool use
LL
IFeelSoSprunki 8B Llama3.1
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
CH
Chili Dog 8B
Chili · MaziyarPanahi
Params8.41B
Context8K
Smallest5.9 GB
GGUF
CH
MN Chinofun 12B 3
Chinofun · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
GGUF
FI
models--mergekit-community--Synaptica
Fimbulvetr · MaziyarPanahi
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF
AN
AngelSlayer 12B Unslop Mell RPMax DARKNESS v2
Angelslayer · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
MI
models--mergekit-community--mergekit-ties-itmchpd
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
Matsu 7B
Matsu · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
Tool use
QW
Qwen2.5 14B Vimarckoso v3 Slerp
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
MI
Mini synata 7b 011 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral ko 7B v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UW
UwU 14B Math v0.2
Uwu · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
GGUF

Keep browsing