GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 7b chat hf
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
notus 7b v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Falkor 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
models--automerger--AlloyingotneoyPercival_01-7B
Alloyingotneoy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral ft optimized 1227
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
ME
MetaMath Bagel DPO 34B
Metamath · MaziyarPanahi
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
ST
models--automerger--Strangemerges_32Yamshadow-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.2-instruct-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
Mistral 7B Instruct v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
calme-3.2-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MI
neural chat 7b v3 1 dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
models--google--gemma-1.1-2b-it
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Mistral 7B Alpaca 52k v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
speechless mistral six in one 7b orth 1.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MY
models--automerger--NeuralsynthesisMyriad-7B
Myriad · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OG
models--automerger--CalmexperimentOgnoexperiment27multi_verse_model-7B
Ognoexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-jfynlwk
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
LeoScorpius GreenNode Platypus 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
UN
models--mergekit-community--mergekit-slerp-ebgdloh
Una · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
Models LGAI EXAONE EXAONE 3.5 7.8B Instruct
Exaone · MaziyarPanahi
Params7.82B
Context32K
Q4_K_M4.8 GB
GGUF
LL
calme-3.3-llamaloi-3b
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
KO
Kosmos EVAA TSN light 8B
Kosmos · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
MI
SlimOpenOrca Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral ft optimized 1227 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MU
models--automerger--Ognoexperiment27Multi_verse_model-7B
Multi · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
blossom v3 1 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
Codepy Deepthink 3B
Codepy · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Tool use
EX
models--automerger--Experiment29Pastiche-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Noromaid 7b v0.1.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
IC
IceMartiniV1RP 7b
Icemartiniv · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF

Keep browsing