GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MI
models--mergekit-community--mergekit-slerp-sclthpf
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3 8B Instruct DPO v0.3 32k
Llama · MaziyarPanahi
Params8.03B
Context31K
Q4_K_M4.9 GB
MI
speechless code mistral 7b v2.0 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StructLM 7B
Structlm · MaziyarPanahi
Params6.74B
Context16K
Q4_K_M4.1 GB
MI
shisa 7b v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
NE
Nemotron Mini 4B Instruct
Nemotron · MaziyarPanahi
Params4.19B
Context4K
Q4_K_M2.7 GB
MI
mistral 7b finetuned orca dpo v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--ShadowCalme-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 Mistral 7B mt bench DPO original v3
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NyakuraV2.1 m7 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--T3qm7xExperiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Models Mlx Community Llama 3.2 3B Bf16
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
MI
Mistral 7B v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
Meraj Mini
Meraj · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
zephyr 7b beta
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CollectiveCognition v1.1 Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama 3.2 3B Instruct
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
MI
NeuralHermes 2.5 Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Ferret 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
reader lm 0.5b
Reader · MaziyarPanahi
Params494M
Context250K
Q4_K_M0.4 GB
MO
models--automerger--Multi_verse_modelM7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
testllm c2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
Ayla Light 12B
Ayla · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
LL
models--mergekit-community--TopEvolution16
Llama · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
models--mergekit-community--mergekit-slerp-bqvdymn
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
Models Huihui Ai Granite 3.2 2b Instruct Abliterated
Granite · MaziyarPanahi
Params2.53B
Context128K
Smallest1.8 GB
YA
models--automerger--ShadowYam-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Huihui Ai Qwen2.5 3B Instruct Abliterated
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
MI
LeoScorpius GreenNode Platypus 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB