GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
LL
Llama 2 7b chat hf
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
notus 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Falkor 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
AL
models--automerger--AlloyingotneoyPercival_01-7B
Alloyingotneoy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral ft optimized 1227
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
MetaMath Bagel DPO 34B
Metamath · MaziyarPanahi
Params34.4B
Context195K
Q4_K_M20.7 GB
ST
models--automerger--Strangemerges_32Yamshadow-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
calme-3.2-instruct-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
calme-3.2-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
neural chat 7b v3 1 dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
models--google--gemma-1.1-2b-it
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
Mistral 7B Alpaca 52k v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
speechless mistral six in one 7b orth 1.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MY
models--automerger--NeuralsynthesisMyriad-7B
Myriad · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OG
models--automerger--CalmexperimentOgnoexperiment27multi_verse_model-7B
Ognoexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-jfynlwk
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
LeoScorpius GreenNode Platypus 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
models--mergekit-community--mergekit-slerp-ebgdloh
Una · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
Models LGAI EXAONE EXAONE 3.5 7.8B Instruct
Exaone · MaziyarPanahi
Params7.82B
Context32K
Q4_K_M4.8 GB
LL
calme-3.3-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
KO
Kosmos EVAA TSN light 8B
Kosmos · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
MI
SlimOpenOrca Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral ft optimized 1227 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MU
models--automerger--Ognoexperiment27Multi_verse_model-7B
Multi · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
blossom v3 1 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
Codepy Deepthink 3B
Codepy · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
EX
models--automerger--Experiment29Pastiche-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Noromaid 7b v0.1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
IC
IceMartiniV1RP 7b
Icemartiniv · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB