GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM 360M Instruct
SmolLM · MaziyarPanahi
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-ghxdzjf
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
KU
models--mergekit-community--mergekit-slerp-jdsasof
Kunoichi · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.0 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openbuddy zephyr 7b v14.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
models--google--codegemma-2b
Codegemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Synatra 7B Instruct v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PE
Models ClosedCharacter Peach 2.0 9B 8k Roleplay
Peach · MaziyarPanahi
Params8.83B
Context16K
Smallest6.1 GB
Roleplay
MI
Mistral 7B model 45k6e2e4 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OG
models--automerger--Experiment24Ognoexperiment27-7B
Ognoexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.1-instruct-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
MI
CollectiveCognition v1.1 Mistral 7B dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SynthIA 7B v1.3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
models--mergekit-community--mergekit-slerp-ffdcfot
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Yarn Mistral 7b 64k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
EX
models--automerger--Percival_01Experiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct SQL Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Rabbit 7B DPO Chat Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 3 Mini 4k Instruct
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
YI
models--01-ai--Yi-1.5-9B-Chat
Yi · MaziyarPanahi
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
CA
Calme 7B Instruct v0.1
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
ST
models--automerger--Strangemerges_32Inex12-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NSFW DPO Noromaid 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
MI
NeuralPipe 7B slerp v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
speechless code mistral 7b v2.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
QW
calme 2.8 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
models--mergekit-community--mergekit-ties-aspkrwz
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
SA
models--mergekit-community--mergekit-slerp-qcerglv
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TH
TheTop 5x7B Instruct T v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
calme-3.2-baguette-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF

Keep browsing