GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CU
CursorCore QW2.5 7B
Cursorcore · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB
GGUF
QW
calme 3.3 qwenloi 3b
Qwen · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
OM
NeuralOmniBeagle 7B
Omnibeagle · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Models Deepcogito Cogito v1 Preview Llama 70B
Llama · MaziyarPanahi
Params70.6B
Context128K
Q4_K_M42.5 GB
ReasoningTool use
MI
Mistral 2.5 Prima Hercules Fusion 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
LL
Llama 3 8B Sydney
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
MI
openchat 3.5 16k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
Vikhrmodels/Vikhr-YandexGPT-5-Lite-8B-it
Vikhr · MaziyarPanahi
Params8.04B
Context32K
Smallest5.6 GB
GGUF
LL
Models Ilsp Llama Krikri 8B Instruct
Llama · MaziyarPanahi
Params8.2B
Context128K
Smallest5.7 GB
Tool use
MI
MythoMist 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama3 8B DarkIdol 2.2 Uncensored 1048K B
Llama · MaziyarPanahi
Params8.03B
Context1024K
Smallest5.6 GB
GGUF
MI
SynthIA 7B v1.3 dare 0.85 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
calme 2.2 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 7B YOYO
Qwen · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
Tool use
WI
models--mergekit-community--mergekit-slerp-jplqsgv
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
mistral ft optimized 1218 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mini synatra 7b 03 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KY
Kyro n1 3B
Kyro · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
Reasoning
MI
zephyr 7b alpha
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek Llama3.1 Bllossom 8
DeepSeek · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
MI
MISCHIEVOUS 12B
Mischievous · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
MI
models--mergekit-community--mergekit-slerp-mczwvqr
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
em german leo mistral Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
OpenHermes 2.5 neural chat v3 2 Slerp Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
CatPPT base Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama Deepsync 3B
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Tool use
QW
Qwen2.5 14B Brocav3
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
MI
CollectiveCognition v1.1 Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
FuseCyberMix Qwen 2.5 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
Tool use
AP
Models Swiss Ai Apertus 8B Instruct 2509
Apertus · MaziyarPanahi
Params8.05B
Context64K
Q4_K_M5.1 GB
ReasoningTool use

Keep browsing