GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MI
neural chat 7b v3 3 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Marcoroni neural chat 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
llama3 8B DarkIdol 2.1 Uncensored 32K
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
IN
models--automerger--Inex12Yamshadow-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
neural chat 7b v3 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mindy 7b v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
neural chat 7b v3 1 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
models--automerger--YamT3qm7xp-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OG
models--automerger--Ognoexperiment27multi_verse_modelExperiment27pastiche-7B
Ognoexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
TheTop 5x7B Instruct D v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--YamShadow-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hermes2 Gutenberg2 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
EX
models--automerger--Experiment26Percival_01-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B KNUT v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
Models HuggingFaceTB SmolLM2 1.7B
SmolLM · MaziyarPanahi
Params1.71B
Context8K
Smallest1.2 GB
MI
Optimus 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
MetaMath Chupacabra 7B v2.01 Slerp
Metamath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--Experiment24Shadow-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Marcoroni neural chat 7B v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
TheTop 5x7B Instruct S4 v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openbuddy mistral 7b v13 base Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B KNUT v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
japanese stablelm base gamma 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephykor ko beta 7b chang Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
PiVoT 10.7B Mistral v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
calme-3.3-baguette-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
openchat 3.5 16k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SynthIA 7B v1.5 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
models--mergekit-community--mergekit-passthrough-lkwyfft
Fimbulvetr · MaziyarPanahi
Params10.7B
Context4K
Q4_K_M6.5 GB
FR
Franken MoE 18B v0.1
Franken · MaziyarPanahi
Params18.5B
Context32K
Q4_K_M11.2 GB