GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
CU
CursorCore QW2.5 7B
Cursorcore · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB
QW
calme 3.3 qwenloi 3b
Qwen · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
OM
NeuralOmniBeagle 7B
Omnibeagle · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Models Deepcogito Cogito v1 Preview Llama 70B
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Mistral 2.5 Prima Hercules Fusion 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
LL
Llama 3 8B Sydney
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
MI
openchat 3.5 16k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
Vikhrmodels/Vikhr-YandexGPT-5-Lite-8B-it
Vikhr · MaziyarPanahi
Params8.04B
Context32K
Smallest5.6 GB
LL
Models Ilsp Llama Krikri 8B Instruct
Llama · MaziyarPanahi
Params8.2B
Context128K
Smallest5.7 GB
MI
MythoMist 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama3 8B DarkIdol 2.2 Uncensored 1048K B
Llama · MaziyarPanahi
Params8.03B
Context1024K
Smallest5.6 GB
MI
SynthIA 7B v1.3 dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
calme 2.2 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen2.5 7B YOYO
Qwen · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
WI
models--mergekit-community--mergekit-slerp-jplqsgv
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral ft optimized 1218 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mini synatra 7b 03 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
KY
Kyro n1 3B
Kyro · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
MI
zephyr 7b alpha
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
DeepSeek Llama3.1 Bllossom 8
DeepSeek · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
MI
MISCHIEVOUS 12B
Mischievous · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MI
models--mergekit-community--mergekit-slerp-mczwvqr
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
em german leo mistral Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 neural chat v3 2 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
CatPPT base Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama Deepsync 3B
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
QW
Qwen2.5 14B Brocav3
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
MI
CollectiveCognition v1.1 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
FuseCyberMix Qwen 2.5 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
AP
Models Swiss Ai Apertus 8B Instruct 2509
Apertus · MaziyarPanahi
Params8.05B
Context64K
Q4_K_M5.1 GB