GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
OR
models--mergekit-community--mergekit-ties-polycrr
Orca · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
EX
Models LGAI EXAONE EXAONE 3.5 2.4B Instruct
Exaone · MaziyarPanahi
Params2.41B
Context32K
Q4_K_M1.5 GB
BI
BioMistral Clinical 7B
Biomistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
LL
Models Hiyouga Qwen 14B Chat LLaMAfied
Llama · MaziyarPanahi
Params14.2B
Context8K
Smallest10.0 GB
MI
MISCHIEVOUS 12B Mix 0.4v
Mischievous · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
NE
Models Nvidia NVIDIA Nemotron Nano 9B v2
Nemotron · MaziyarPanahi
Params8.89B
Context1024K
Q4_K_M6.5 GB
AY
Ayla Light 12B
Ayla · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MI
mistral 7b v5 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Models Deepcogito Cogito v1 Preview Llama 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
IN
models--automerger--Inex12Neural-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
Metis 0.4
Metis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment27Inex12-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Captain BMO 0.420 Magnum 12B
Captain · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
OP
openthaigpt1.5 7b instruct
Openthaigpt · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
MI
Mistral Nemo Kurdish Instruct
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
LA
Models prithivMLmods Lacerta Opus 14B Elite8
Lacerta · MaziyarPanahi
Params14.8B
Context986K
Smallest10.3 GB
QW
Models Qwen Qwen2.5 Coder 14B
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
LL
Models prithivMLmods DeepHermes 3 Llama 3 3B Preview Abliterated
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
LL
IFeelSoSprunki 8B Llama3.1
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
CH
Chili Dog 8B
Chili · MaziyarPanahi
Params8.41B
Context8K
Smallest5.9 GB
CH
MN Chinofun 12B 3
Chinofun · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
FI
models--mergekit-community--Synaptica
Fimbulvetr · MaziyarPanahi
Params10.7B
Context8K
Q4_K_M6.5 GB
AN
AngelSlayer 12B Unslop Mell RPMax DARKNESS v2
Angelslayer · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MI
models--mergekit-community--mergekit-ties-itmchpd
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
Matsu 7B
Matsu · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
QW
Qwen2.5 14B Vimarckoso v3 Slerp
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
MI
Mini synata 7b 011 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral ko 7B v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
UW
UwU 14B Math v0.2
Uwu · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB