GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
QW
Models Qwen Qwen2.5 0.5B Instruct
Qwen · MaziyarPanahi
Params494M
Context32K
Q4_K_M0.4 GB
AL
models--automerger--AlloyingotneoyYam-7B
Alloyingotneoy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolLM2 1.7B Instruct
SmolLM · MaziyarPanahi
Params1.71B
Context8K
Q4_K_M1.1 GB
ZE
models--mergekit-community--mergekit-slerp-jeyctse
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
TO
models--mergekit-community--TopEvolution-DPO-32K
Topevolution · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--mergekit-passthrough-kijjzjp
Llama · MaziyarPanahi
Params11.5B
Context8K
Q4_K_M7.0 GB
LL
models--mergekit-community--mergekit-slerp-tzunwnr
Llama · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--Shadowm7expMeliodaspercival_01_experiment26t3q-7B
Shadowm · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
models--automerger--CalmexperimentT3qm7-7B
Calmexperimentt · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OR
models--mergekit-community--mergekit-ties-fnacfof
Orca · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
PA
models--automerger--Experiment27Pastiche-7B
Pastiche · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
models--MaziyarPanahi--Calme-12B-Instruct-v0.1
Calme · MaziyarPanahi
Params12.5B
Context32K
Q4_K_M7.5 GB
YA
models--automerger--Experiment26Yamshadow-7B
Yamshadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
calme 2.1 phi3 4b
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
NE
models--automerger--M7Neuralsynthesis-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · MaziyarPanahi
Params8B
Context128K
Q4_K_M4.9 GB
GE
models--google--gemma-7b-it
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
MI
Venomia 1.1 m7 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenCodeInterpreter DS 6.7B
Opencodeinterpreter · MaziyarPanahi
Params6.74B
Context16K
Q4_K_M4.1 GB
CA
calme-2.3-legalkit-8b
Calme · MaziyarPanahi
Params8B
Context128K
Q4_K_M4.9 GB
XL
Models Salesforce xLAM 8x22b R
Xlam · MaziyarPanahi
Params141B
Context64K
Q4_K_M38.4 GB
EX
models--automerger--Experiment28Meliodas-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LW
models--mergekit-community--LWM-14b-Text-Chat-1M
Lwm · MaziyarPanahi
Params6.74B
Context1024K
Q4_K_M4.1 GB
CA
models--MaziyarPanahi--Calme-7B-Instruct-v0.9
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
zephyr 7b beta nf4 fp16 upscaled
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TinyMistral 248M v2.5 Instruct
Tinymistral · MaziyarPanahi
Params248M
Context32K
Q4_K_M0.2 GB
LL
Llama 3.2 3B Instruct
Llama · MaziyarPanahi
Params3.61B
Context128K
Q4_K_M2.2 GB
EX
models--automerger--YamshadowExperiment27pastiche-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--mergekit-slerp-oztfijl
Llama · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Models Sail Sailor2 1B Chat
Sailor · MaziyarPanahi
Params988M
Context32K
Q4_K_M0.7 GB