GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CU
cursa o1 7b v1.1
Cursa · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB
Tool use
MI
NyakuraV2.1 m7 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
ReWiz Nemo 12B Instruct
Rewiz · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
LL
LlamaThink 8B Instruct
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
RH
L3 Rhaenys 8B
Rhaenys · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
models--mergekit-community--mergekit-passthrough-kfpckkg
Llama · MaziyarPanahi
Params12.2B
Context8K
Q4_K_M7.4 GB
GGUF
OL
Models Allenai Olmo 3 32B Think
OLMo · MaziyarPanahi
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
LL
Llama 3.2 3B Booval
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Tool use
LL
Llama OpenReviewer 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
GE
MT Gen7 gemma 2 9B
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
GGUF
FA
FastApply 1.5B v1.0
Fastapply · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
GGUF
MR
MrRoboto BASE Unholy 8b 64k
Mrroboto · MaziyarPanahi
Params8.03B
Context1024K
Smallest5.6 GB
GGUF
MI
MRAI synatra 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Models Choco58 MistraMystic
Mistramystic · MaziyarPanahi
Params7.25B
Context32K
Smallest5.0 GB
GGUF
QW
Models Qwen Qwen2.5 Coder 7B
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
CodingTool use
LL
Llama 3.1 8b DodoWild v2.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
MI
Seraph 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b open platypus Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Models FlagAlpha Llama3 Chinese 8B Instruct
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
CL
Clarus 7B v0.1
Clarus · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
LL
Llama 3 Aetheric Hermes Lexi Smaug 8B
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
Tool use
QW
QwenSlerp 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
DA
Dark Science 12B
Dark · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
QW
Dumpling Qwen2.5 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
LL
Llama 3.1 TAIDE R1 8B Chat
Llama · MaziyarPanahi
Params8.52B
Context128K
Smallest6.0 GB
ReasoningTool use
CO
Community Request 03 12B
Community · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
BY
ByteCraft
Bytecraft · MaziyarPanahi
Params8.39B
Context32K
Smallest5.9 GB
Tool use
MI
Mistral 7B golden Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama3 8B Aifeifei 1.3
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
WI
models--mergekit-community--mergekit-slerp-qabprkt
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing