GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
CU
cursa o1 7b v1.1
Cursa · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB
MI
NyakuraV2.1 m7 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
ReWiz Nemo 12B Instruct
Rewiz · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
LL
LlamaThink 8B Instruct
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
RH
L3 Rhaenys 8B
Rhaenys · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
models--mergekit-community--mergekit-passthrough-kfpckkg
Llama · MaziyarPanahi
Params12.2B
Context8K
Q4_K_M7.4 GB
OL
Models Allenai Olmo 3 32B Think
OLMo · MaziyarPanahi
Params32.2B
Context64K
Q4_K_M19.5 GB
LL
Llama 3.2 3B Booval
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
LL
Llama OpenReviewer 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GE
MT Gen7 gemma 2 9B
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
FA
FastApply 1.5B v1.0
Fastapply · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
MR
MrRoboto BASE Unholy 8b 64k
Mrroboto · MaziyarPanahi
Params8.03B
Context1024K
Smallest5.6 GB
MI
MRAI synatra 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Models Choco58 MistraMystic
Mistramystic · MaziyarPanahi
Params7.25B
Context32K
Smallest5.0 GB
QW
Models Qwen Qwen2.5 Coder 7B
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
LL
Llama 3.1 8b DodoWild v2.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
MI
Seraph 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b open platypus Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Models FlagAlpha Llama3 Chinese 8B Instruct
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
CL
Clarus 7B v0.1
Clarus · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
LL
Llama 3 Aetheric Hermes Lexi Smaug 8B
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
QW
QwenSlerp 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
DA
Dark Science 12B
Dark · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
QW
Dumpling Qwen2.5 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
LL
Llama 3.1 TAIDE R1 8B Chat
Llama · MaziyarPanahi
Params8.52B
Context128K
Smallest6.0 GB
CO
Community Request 03 12B
Community · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
BY
ByteCraft
Bytecraft · MaziyarPanahi
Params8.39B
Context32K
Smallest5.9 GB
MI
Mistral 7B golden Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Llama3 8B Aifeifei 1.3
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
WI
models--mergekit-community--mergekit-slerp-qabprkt
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB