GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
LL
models--mergekit-community--mergekit-ties-anlytjh
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
LA
Lamarck 14B v0.7 Fusion
Lamarck · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
HE
Models HelpingAI Helpingai3 Raw
Helpingai · MaziyarPanahi
Params10.3B
Context32K
Smallest7.1 GB
MI
zephyr 7b alpha dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B KNUT v0.3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
models--automerger--Strangemerges_32Strangemerges_30-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Chupacabra 7B v2.01 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
Yarn Solar 10b 64k
Yarn · MaziyarPanahi
Params10.7B
Context64K
Q4_K_M6.5 GB
MI
DPOpenHermes 7B v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
MFANN Llama3.1 Abliterated Slerp TIES
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
WI
models--mergekit-community--mergekit-slerp-mpovshq
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-DPO-v0.4
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek R1 Distill Llama 3B
DeepSeek · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
CA
calme-3.3-instruct-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
Synatra 7B Instruct v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
distilabeled Marcoro14 7B slerp
Marcoro · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-ijnxdha
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
PiVoT 0.1 early Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
jackalope 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
MI
ANIMA Nectar v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 neural chat v3 3 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistralopithecus v1 dpo 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.3
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Marcoroni neural chat 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
models--automerger--Strangemerges_32Alloyingotneoy-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
em german leo mistral Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-rcoqutv
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B v0.1 Open Platypus Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB