GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
LL
llm 3 2 flux prompt
Llm · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
MO
models--automerger--M7Yamshadowexperiment28-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment27Experiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolLM2 135M Instruct
SmolLM · MaziyarPanahi
Params135M
Context8K
Q4_K_M0.1 GB
ZE
models--mergekit-community--mergekit-slerp-fodinzo
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
models--google--codegemma-7b-it
Codegemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
IN
models--automerger--YamshadowInex12-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Huihui Ai Qwen2.5 Coder 3B Instruct Abliterated
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
EV
L3 8B Everything COT
Everything · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
SA
samantha 1.1 westlake 7b
Samantha · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Tulpar 7b v2 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
finetuned mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
typhoon 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--NeuralsirkrishnaExperiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
models--automerger--NeuralExperiment26-7B
Neural · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
models--automerger--MeliodasT3q-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment24Yam-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
BI
Bioxtral 4x7B v0.1
Bioxtral · MaziyarPanahi
Params24.2B
Context32K
Q4_K_M14.6 GB
ME
models--automerger--MergerixShadowm7exp-7B
Mergerix · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
airoboros m 7b 3.1.2 dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
typhoon 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SciPhi Mistral 7B 32k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SciPhi Mistral 7B 32k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Models Tiiuae Falcon3 10B Instruct
Falcon · MaziyarPanahi
Params10.3B
Context32K
Smallest7.1 GB
MI
models--mergekit-community--mergekit-slerp-llfrpky
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi 9B
Yi · MaziyarPanahi
Params8.83B
Context4K
Q4_K_M5.3 GB
MI
models--mergekit-community--mergekit-slerp-xxzrbzh
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
test help steer filtered orig Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
models--automerger--PasticheInex12-7B
Pastiche · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--T3qT3qm7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB