GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
YA
models--automerger--Experiment27pasticheYamshadowexperiment28-7B
Yamshadowexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LF
Models LiquidAI LFM2 24B A2B
Lfm · MaziyarPanahi
Params23.8B
Context125K
Q4_K_M14.4 GB
MI
MistralInstructLongish Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Phi 3 Mini 4k Instruct
Phi · MaziyarPanahi
Params3.82B
Context4K
Smallest2.6 GB
BI
BioMistral 7B SLERP
Biomistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openchat 3.5 0106 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
PiVoT 0.1 early Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Rabbit 7B DPO Chat Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
calme 2.3 llama3 70b
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
BI
BioMistral 7B DARE
Biomistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
models--automerger--CalmexperimentPercival_01-7B
Calmexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--llama-world
Llama · MaziyarPanahi
Params6.74B
Context1024K
Q4_K_M4.1 GB
MI
models--mergekit-community--mergekit-slerp-sictdhe
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
calme-3.1-baguette-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
MO
models--automerger--Percival_01M7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolTulu 1.7b RM
Smoltulu · MaziyarPanahi
Params1.71B
Context8K
Smallest1.2 GB
RO
models--mergekit-community--EvoluzioneRed
Rogue · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 7B Symbolic Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Dans 07YahooAnswers 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral 8x7B v0.1
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
WizardMath 7B V1.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi 6B 200K
Yi · MaziyarPanahi
Params6.06B
Context195K
Q4_K_M3.7 GB
ME
models--automerger--MeliodasNeuralsirkrishna-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Cybertron Starling Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephyr 7b alpha sharded Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PE
models--automerger--Percival_01Yamshadow-7B
Percival · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
pic 7B mistral Full v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--AlloyingotneoyExperiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
smartyplats 7b v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mindy 7b v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB