GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Models MiniLLM MiniPLM Qwen 1.2B
Qwen · MaziyarPanahi
Params1.16B
Context32K
Smallest0.8 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-jlrpbqb
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AS
ASR Fixer
Asr · MaziyarPanahi
Params7.24B
Context4K
Smallest5.0 GB
GGUF
MI
blossom v3 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5-7B-sft-ultrachat-SPIN-gpt4o
Qwen · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
GGUF
LL
Llama 3.2 3B Apex
Llama · MaziyarPanahi
Params3.61B
Context128K
Smallest2.5 GB
Tool use
NE
models--automerger--Strangemerges_32Neuralsirkrishna-7B
Neuralsirkrishna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Models Mistralai Ministral 3 8B Reasoning 2512
Mistral · MaziyarPanahi
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool use
ME
Megrez 3B Instruct
Megrez · MaziyarPanahi
Params2.92B
Context32K
Smallest2.1 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-ovodfvr
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Qwenvergence 14B v3 Prose
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
MI
speechless code mistral orca 7b v1.0 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
LU
Lumimaid Magnum v4 12B
Lumimaid · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
Tool use
SA
RP SAINEMO
Sainemo · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Roleplay
LL
Llama 3.1 8B RainbowLight EtherealMix
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
QW
Models C10X LongWriter Qwen2.5 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
QW
Korean QWEN Coder2.5 14B
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
CodingTool use
CO
COCO 7B Instruct 1M
Coco · MaziyarPanahi
Params7.62B
Context986K
Smallest5.3 GB
Tool use
CA
Capt Dark Science 12B
Capt · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
CL
Clarus 7B v0.3
Clarus · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
PH
phi 2 pytdml
Phi · MaziyarPanahi
Params2.78B
Context2K
Smallest1.9 GB
GGUF
MI
Models Sthenno Com Miscii 14b 1225
Miscii · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
GGUF
OP
openthaigpt1.5 14b instruct
Openthaigpt · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
Tool use
ST
stackexchange movies
Stackexchange · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
MI
shark tank ai 7 b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment26Experiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Metis 0.4 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
koOpenChat sft Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
pic 7B mistral Full v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
models--mergekit-community--mergekit-slerp-jxmncon
Stealth · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing