GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
SM
SmolLM 360M Instruct
SmolLM · MaziyarPanahi
Params362M
Context2K
Q4_K_M0.3 GB
MI
models--mergekit-community--mergekit-slerp-ghxdzjf
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
KU
models--mergekit-community--mergekit-slerp-jdsasof
Kunoichi · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
dolphin 2.0 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openbuddy zephyr 7b v14.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
models--google--codegemma-2b
Codegemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
Synatra 7B Instruct v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PE
Models ClosedCharacter Peach 2.0 9B 8k Roleplay
Peach · MaziyarPanahi
Params8.83B
Context16K
Smallest6.1 GB
MI
Mistral 7B model 45k6e2e4 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OG
models--automerger--Experiment24Ognoexperiment27-7B
Ognoexperiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
calme-3.1-instruct-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
CollectiveCognition v1.1 Mistral 7B dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SynthIA 7B v1.3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
models--mergekit-community--mergekit-slerp-ffdcfot
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Yarn Mistral 7b 64k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Percival_01Experiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Instruct SQL Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Rabbit 7B DPO Chat Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Phi 3 Mini 4k Instruct
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
YI
models--01-ai--Yi-1.5-9B-Chat
Yi · MaziyarPanahi
Params8.83B
Context4K
Q4_K_M5.3 GB
CA
Calme 7B Instruct v0.1
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
models--automerger--Strangemerges_32Inex12-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NSFW DPO Noromaid 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NeuralPipe 7B slerp v0.2
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
speechless code mistral 7b v2.0 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
calme 2.8 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
models--mergekit-community--mergekit-ties-aspkrwz
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
SA
models--mergekit-community--mergekit-slerp-qcerglv
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
TH
TheTop 5x7B Instruct T v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
calme-3.2-baguette-3b
Calme · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB