GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
neural chat 7b v3 3 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Marcoroni neural chat 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama3 8B DarkIdol 2.1 Uncensored 32K
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
IN
models--automerger--Inex12Yamshadow-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
neural chat 7b v3 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mindy 7b v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
neural chat 7b v3 1 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
models--automerger--YamT3qm7xp-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OG
models--automerger--Ognoexperiment27multi_verse_modelExperiment27pastiche-7B
Ognoexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
TheTop 5x7B Instruct D v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SH
models--automerger--YamShadow-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Hermes2 Gutenberg2 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
Tool use
EX
models--automerger--Experiment26Percival_01-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B KNUT v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
Models HuggingFaceTB SmolLM2 1.7B
SmolLM · MaziyarPanahi
Params1.71B
Context8K
Smallest1.2 GB
GGUF
MI
Optimus 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
MetaMath Chupacabra 7B v2.01 Slerp
Metamath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SH
models--automerger--Experiment24Shadow-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Marcoroni neural chat 7B v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
TheTop 5x7B Instruct S4 v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openbuddy mistral 7b v13 base Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B KNUT v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
japanese stablelm base gamma 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephykor ko beta 7b chang Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
PiVoT 10.7B Mistral v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.3-baguette-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
openchat 3.5 16k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SynthIA 7B v1.5 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FI
models--mergekit-community--mergekit-passthrough-lkwyfft
Fimbulvetr · MaziyarPanahi
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
FR
Franken MoE 18B v0.1
Franken · MaziyarPanahi
Params18.5B
Context32K
Q4_K_M11.2 GB
GGUF

Keep browsing