GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
models--mergekit-community--mergekit-ties-anlytjh
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LA
Lamarck 14B v0.7 Fusion
Lamarck · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
HE
Models HelpingAI Helpingai3 Raw
Helpingai · MaziyarPanahi
Params10.3B
Context32K
Smallest7.1 GB
GGUF
MI
zephyr 7b alpha dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B KNUT v0.3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
models--automerger--Strangemerges_32Strangemerges_30-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MetaMath Chupacabra 7B v2.01 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
Yarn Solar 10b 64k
Yarn · MaziyarPanahi
Params10.7B
Context64K
Q4_K_M6.5 GB
Coding
MI
DPOpenHermes 7B v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
MFANN Llama3.1 Abliterated Slerp TIES
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
WI
models--mergekit-community--mergekit-slerp-mpovshq
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-DPO-v0.4
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek R1 Distill Llama 3B
DeepSeek · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Reasoning
CA
calme-3.3-instruct-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
Synatra 7B Instruct v0.2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
distilabeled Marcoro14 7B slerp
Marcoro · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-ijnxdha
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
PiVoT 0.1 early Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
jackalope 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
MI
ANIMA Nectar v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 neural chat v3 3 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistralopithecus v1 dpo 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.3
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Marcoroni neural chat 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MetaMath Mistral 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
models--automerger--Strangemerges_32Alloyingotneoy-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
em german leo mistral Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-rcoqutv
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mistral 7B v0.1 Open Platypus Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing