GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
NE
models--automerger--NeuralsynthesisMultiverseex26-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--T3qT3qm7xp-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
models--automerger--NeuralsynthesisT3qm7-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment26Mergerix-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--Inex12M7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--T3qm7xExperiment26-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--Inex12T3qm7xp-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment27pasticheT3qm7xp-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
models--automerger--NeuralsynthesisInex12-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 13B Instruct v0.1
Llama · MaziyarPanahi
Params13.3B
Context8K
Q4_K_M8.1 GB
AL
models--automerger--AlloyingotneoyExperiment24-7B
Alloyingotneoy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
models--automerger--Inex16Calme-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 11B Instruct v0.1
Llama · MaziyarPanahi
Params11.5B
Context8K
Q4_K_M7.0 GB
QW
Models Qwen Qwen2.5 3B Instruct
Qwen · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
SH
models--automerger--ShadowT3q-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--Shadowm7expMergerix-7B
Shadowm · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
models--automerger--YamExperiment26-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
models--automerger--Yamshadowexperiment28T3qm7xp-7B
Yamshadowexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LW
models--mergekit-community--mergekit-slerp-ozbsicw
Lwm · MaziyarPanahi
Params6.74B
Context1024K
Q4_K_M4.1 GB
CA
models--mergekit-community--YorkShire11
Carbonbeagle · MaziyarPanahi
Params7.24B
Context4K
Q4_K_M4.4 GB
MO
models--automerger--Yamshadowexperiment28M7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
models--automerger--YamshadowExperiment28-7B
Yamshadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Qwen Qwen2.5 32B Instruct
Qwen · MaziyarPanahi
Params32.8B
Context32K
Q4_K_M19.9 GB
CA
Calme 7B Instruct v0.3
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
TO
models--Iker--TowerInstruct-7B-v0.2-EN2ES
Towerinstruct · MaziyarPanahi
Params6.74B
Context8K
Q4_K_M4.1 GB
GE
models--google--gemma-7b
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
ME
models--automerger--NeuralsynthesisMeliodas-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
models--automerger--Experiment27Yam-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
models--Qwen--Qwen2-1.5B-Instruct
Qwen · MaziyarPanahi
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.10
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB