GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Models Qwen Qwen2.5 0.5B Instruct
Qwen · MaziyarPanahi
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
AL
models--automerger--AlloyingotneoyYam-7B
Alloyingotneoy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · MaziyarPanahi
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
ZE
models--mergekit-community--mergekit-slerp-jeyctse
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TO
models--mergekit-community--TopEvolution-DPO-32K
Topevolution · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--mergekit-passthrough-kijjzjp
Llama · MaziyarPanahi
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
LL
models--mergekit-community--mergekit-slerp-tzunwnr
Llama · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
SH
models--automerger--Shadowm7expMeliodaspercival_01_experiment26t3q-7B
Shadowm · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
models--automerger--CalmexperimentT3qm7-7B
Calmexperimentt · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
models--mergekit-community--mergekit-ties-fnacfof
Orca · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
PA
models--automerger--Experiment27Pastiche-7B
Pastiche · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
models--MaziyarPanahi--Calme-12B-Instruct-v0.1
Calme · MaziyarPanahi
Params12.5B
Context32K
Q4_K_M7.5 GB
GGUF
YA
models--automerger--Experiment26Yamshadow-7B
Yamshadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
calme 2.1 phi3 4b
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
NE
models--automerger--M7Neuralsynthesis-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored V2
Llama · MaziyarPanahi
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
models--google--gemma-7b-it
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MI
Venomia 1.1 m7 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenCodeInterpreter DS 6.7B
Opencodeinterpreter · MaziyarPanahi
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
CA
calme-2.3-legalkit-8b
Calme · MaziyarPanahi
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
XL
Models Salesforce xLAM 8x22b R
Xlam · MaziyarPanahi
Params141B
Context64K
Q4_K_M38.4 GB
Tool use
EX
models--automerger--Experiment28Meliodas-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LW
models--mergekit-community--LWM-14b-Text-Chat-1M
Lwm · MaziyarPanahi
Params6.74B
Context1024K
Q4_K_M4.1 GB
GGUF
CA
models--MaziyarPanahi--Calme-7B-Instruct-v0.9
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
zephyr 7b beta nf4 fp16 upscaled
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TI
TinyMistral 248M v2.5 Instruct
Tinymistral · MaziyarPanahi
Params248M
Context32K
Q4_K_M0.2 GB
Coding
LL
Llama 3.2 3B Instruct
Llama · MaziyarPanahi
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
EX
models--automerger--YamshadowExperiment27pastiche-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--mergekit-slerp-oztfijl
Llama · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Models Sail Sailor2 1B Chat
Sailor · MaziyarPanahi
Params988M
Context32K
Q4_K_M0.7 GB
GGUF

Keep browsing