GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
KAI 7B Instruct v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
phi 2 logical sft
Phi · MaziyarPanahi
Params2.78B
Context4K
Q4_K_M1.7 GB
CodingReasoning
GE
zephyr 7b gemma v0.1
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.1 GB
GGUF
NE
models--automerger--T3qm7xpNeuralsynthesis-7B
Neuralsynthesis · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Nous Hermes 2 Mixtral 8x7B SFT Alpaca
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
Tool use
CA
models--MaziyarPanahi--Calme-4x7B-MoE-v0.1
Calme · MaziyarPanahi
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
QW
Models Qwen Qwen2.5 14B Instruct
Qwen · MaziyarPanahi
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
CO
models--google--codegemma-7b
Codegemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MI
piano medley 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--MaziyarPanahi--zephyr-7b-beta-Mistral-7B-Instruct-v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SciPhi Self RAG Mistral 7B 32k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · MaziyarPanahi
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
WI
models--mergekit-community--mergekit-slerp-ryidhrq
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
EX
models--automerger--Experiment26Experiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
TheTop 5x7B Instruct S2 v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Tess XS v1 3 yarn 128K Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
models--mergekit-community--mergekit-slerp-adolxhj
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 11B Instruct v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
models--automerger--Yamshadowexperiment28Ognoexperiment27multi_verse_model-7B
Yamshadowexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
models--google--gemma-2b-it
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
ZE
zephykor ko beta 7b chang
Zephykor · MaziyarPanahi
Params7.55B
Context32K
Q4_K_M4.6 GB
GGUF
EX
models--automerger--NeuralsirkrishnaExperiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
Models Tiiuae Falcon3 3B Base
Falcon · MaziyarPanahi
Params3.23B
Context32K
Smallest2.3 GB
GGUF
MI
models--automerger--YamshadowT3q-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
speechless code mistral 7b v1.0 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
FI
models--mergekit-community--Fimburs11V3
Fimbulvetr · MaziyarPanahi
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
SA
Saul Instruct v1
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3 Smaug 8B
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
neural chat 11b v3 2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MelloGPT Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing