GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
NE
models--automerger--NeuralsynthesisMultiverseex26-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
models--automerger--T3qT3qm7xp-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
models--automerger--NeuralsynthesisT3qm7-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment26Mergerix-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
models--automerger--Inex12M7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
models--automerger--T3qm7xExperiment26-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
models--automerger--Inex12T3qm7xp-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment27pasticheT3qm7xp-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
models--automerger--NeuralsynthesisInex12-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 13B Instruct v0.1
Llama · MaziyarPanahi
Params13.3B
Context8K
Q4_K_M8.1 GB
GGUF
AL
models--automerger--AlloyingotneoyExperiment24-7B
Alloyingotneoy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IN
models--automerger--Inex16Calme-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 11B Instruct v0.1
Llama · MaziyarPanahi
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
QW
Models Qwen Qwen2.5 3B Instruct
Qwen · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
SH
models--automerger--ShadowT3q-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SH
models--automerger--Shadowm7expMergerix-7B
Shadowm · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
models--automerger--YamExperiment26-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
models--automerger--Yamshadowexperiment28T3qm7xp-7B
Yamshadowexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LW
models--mergekit-community--mergekit-slerp-ozbsicw
Lwm · MaziyarPanahi
Params6.74B
Context1024K
Q4_K_M4.1 GB
GGUF
CA
models--mergekit-community--YorkShire11
Carbonbeagle · MaziyarPanahi
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
MO
models--automerger--Yamshadowexperiment28M7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
models--automerger--YamshadowExperiment28-7B
Yamshadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models Qwen Qwen2.5 32B Instruct
Qwen · MaziyarPanahi
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
CA
Calme 7B Instruct v0.3
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TO
models--Iker--TowerInstruct-7B-v0.2-EN2ES
Towerinstruct · MaziyarPanahi
Params6.74B
Context8K
Q4_K_M4.1 GB
GGUF
GE
models--google--gemma-7b
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
ME
models--automerger--NeuralsynthesisMeliodas-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
models--automerger--Experiment27Yam-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
models--Qwen--Qwen2-1.5B-Instruct
Qwen · MaziyarPanahi
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.10
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
GGUF

Keep browsing