GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
YA
models--automerger--Experiment27pasticheYamshadowexperiment28-7B
Yamshadowexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LF
Models LiquidAI LFM2 24B A2B
Lfm · MaziyarPanahi
Params23.8B
Context125K
Q4_K_M14.4 GB
Tool use
MI
MistralInstructLongish Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · MaziyarPanahi
Params3.82B
Context4K
Smallest2.6 GB
GGUF
BI
BioMistral 7B SLERP
Biomistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openchat 3.5 0106 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
PiVoT 0.1 early Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Rabbit 7B DPO Chat Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
calme 2.3 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
GGUF
BI
BioMistral 7B DARE
Biomistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
models--automerger--CalmexperimentPercival_01-7B
Calmexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--llama-world
Llama · MaziyarPanahi
Params6.74B
Context1024K
Q4_K_M4.1 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-sictdhe
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
CA
calme-3.1-baguette-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
MO
models--automerger--Percival_01M7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolTulu 1.7b RM
Smoltulu · MaziyarPanahi
Params1.71B
Context8K
Smallest1.2 GB
GGUF
RO
models--mergekit-community--EvoluzioneRed
Rogue · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 7B Symbolic Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Dans 07YahooAnswers 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral 8x7B v0.1
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
WizardMath 7B V1.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 6B 200K
Yi · MaziyarPanahi
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
ME
models--automerger--MeliodasNeuralsirkrishna-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MetaMath Cybertron Starling Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b alpha sharded Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PE
models--automerger--Percival_01Yamshadow-7B
Percival · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
pic 7B mistral Full v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
EX
models--automerger--AlloyingotneoyExperiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
smartyplats 7b v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mindy 7b v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing