GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
llm 3 2 flux prompt
Llm · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
GGUF
MO
models--automerger--M7Yamshadowexperiment28-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment27Experiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · MaziyarPanahi
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
ZE
models--mergekit-community--mergekit-slerp-fodinzo
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
models--google--codegemma-7b-it
Codegemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
IN
models--automerger--YamshadowInex12-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models Huihui Ai Qwen2.5 Coder 3B Instruct Abliterated
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
CodingTool use
EV
L3 8B Everything COT
Everything · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
SA
samantha 1.1 westlake 7b
Samantha · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MetaMath Tulpar 7b v2 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
finetuned mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
typhoon 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--NeuralsirkrishnaExperiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
models--automerger--NeuralExperiment26-7B
Neural · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
models--automerger--MeliodasT3q-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment24Yam-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
BI
Bioxtral 4x7B v0.1
Bioxtral · MaziyarPanahi
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
ME
models--automerger--MergerixShadowm7exp-7B
Mergerix · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
airoboros m 7b 3.1.2 dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
typhoon 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SciPhi Mistral 7B 32k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SciPhi Mistral 7B 32k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
Models Tiiuae Falcon3 10B Instruct
Falcon · MaziyarPanahi
Params10.3B
Context32K
Smallest7.1 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-llfrpky
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
YI
Yi 9B
Yi · MaziyarPanahi
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-xxzrbzh
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
test help steer filtered orig Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
models--automerger--PasticheInex12-7B
Pastiche · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
models--automerger--T3qT3qm7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing