GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
models--mergekit-community--mergekit-slerp-sclthpf
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
Llama 3 8B Instruct DPO v0.3 32k
Llama · MaziyarPanahi
Params8.03B
Context31K
Q4_K_M4.9 GB
GGUF
MI
speechless code mistral 7b v2.0 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
ST
StructLM 7B
Structlm · MaziyarPanahi
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF
MI
shisa 7b v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NE
Nemotron Mini 4B Instruct
Nemotron · MaziyarPanahi
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
MI
mistral 7b finetuned orca dpo v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SH
models--automerger--ShadowCalme-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 Mistral 7B mt bench DPO original v3
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
NyakuraV2.1 m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--T3qm7xExperiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Models Mlx Community Llama 3.2 3B Bf16
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
GGUF
MI
Mistral 7B v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
Meraj Mini
Meraj · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MI
zephyr 7b beta
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
CollectiveCognition v1.1 Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Tool use
MI
NeuralHermes 2.5 Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Ferret 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
reader lm 0.5b
Reader · MaziyarPanahi
Params494M
Context250K
Q4_K_M0.4 GB
GGUF
MO
models--automerger--Multi_verse_modelM7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
testllm c2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Ayla Light 12B
Ayla · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
LL
models--mergekit-community--TopEvolution16
Llama · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
WI
models--mergekit-community--mergekit-slerp-bqvdymn
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
GR
Models Huihui Ai Granite 3.2 2b Instruct Abliterated
Granite · MaziyarPanahi
Params2.53B
Context128K
Smallest1.8 GB
Tool use
YA
models--automerger--ShadowYam-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MetaMath Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models Huihui Ai Qwen2.5 3B Instruct Abliterated
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
Tool use
MI
LeoScorpius GreenNode Platypus 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing