GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MI
KAI 7B Instruct v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
phi 2 logical sft
Phi · MaziyarPanahi
Params2.78B
Context4K
Q4_K_M1.7 GB
GE
zephyr 7b gemma v0.1
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.1 GB
NE
models--automerger--T3qm7xpNeuralsynthesis-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Nous Hermes 2 Mixtral 8x7B SFT Alpaca
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
CA
models--MaziyarPanahi--Calme-4x7B-MoE-v0.1
Calme · MaziyarPanahi
Params24.2B
Context32K
Q4_K_M14.6 GB
QW
Models Qwen Qwen2.5 14B Instruct
Qwen · MaziyarPanahi
Params14.8B
Context32K
Q4_K_M9.0 GB
CO
models--google--codegemma-7b
Codegemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
MI
piano medley 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--MaziyarPanahi--zephyr-7b-beta-Mistral-7B-Instruct-v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SciPhi Self RAG Mistral 7B 32k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolLM 135M Instruct
SmolLM · MaziyarPanahi
Params135M
Context2K
Q4_K_M0.1 GB
WI
models--mergekit-community--mergekit-slerp-ryidhrq
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment26Experiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
TheTop 5x7B Instruct S2 v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Tess XS v1 3 yarn 128K Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-adolxhj
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 11B Instruct v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
models--automerger--Yamshadowexperiment28Ognoexperiment27multi_verse_model-7B
Yamshadowexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
models--google--gemma-2b-it
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
ZE
zephykor ko beta 7b chang
Zephykor · MaziyarPanahi
Params7.55B
Context32K
Q4_K_M4.6 GB
EX
models--automerger--NeuralsirkrishnaExperiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Models Tiiuae Falcon3 3B Base
Falcon · MaziyarPanahi
Params3.23B
Context32K
Smallest2.3 GB
MI
models--automerger--YamshadowT3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
speechless code mistral 7b v1.0 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
FI
models--mergekit-community--Fimburs11V3
Fimbulvetr · MaziyarPanahi
Params10.7B
Context4K
Q4_K_M6.5 GB
SA
Saul Instruct v1
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 Smaug 8B
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
neural chat 11b v3 2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MelloGPT Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB