GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
EX
models--automerger--Experiment26T3q-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LO
LongAlpaca 13B
Longalpaca · MaziyarPanahi
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
MistralInstructLongish Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
MI
zephykor ko beta 7b chang Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
models--automerger--Ognoexperiment27M7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
Models Huihui Ai Dria Agent A 3B Abliterated
Models · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
Tool use
GL
Glowing Forest 12B
Glowing · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
MI
Starling LM 11B alpha Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Rombos Coder V2.5 Qwen 14b
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
CodingTool use
OX
oxy 1 small
Oxy · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
GGUF
QW
Qwen2.5 14B Gutenberg 1e Delta
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
Tool use
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ReasoningTool use
LL
models--mergekit-community--nMer1
Llama · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
CA
Models prithivMLmods Calcium Opus 14B Elite2
Calcium · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
MI
Mistral Nemo Prism 12B
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
LL
Einstein v6.1 Llama3 8B
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CH
chinese text correction 1.5b
Chinese · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
Tool use
QW
Qwen 2.5 7B Exp Sce
Qwen · MaziyarPanahi
Params7.61B
Context986K
Smallest5.3 GB
Tool use
FA
Fatgirl v2 8B
Fatgirl · MaziyarPanahi
Params8.41B
Context8K
Smallest5.9 GB
GGUF
FU
FuseQwQen 7B
Fuseqwqen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
ReasoningTool use
YA
models--automerger--YamNeuralsirkrishna-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MA
magnum twilight 12b
Magnum · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
Tool use
QW
Rombos Coder V2.5 Qwen 7b
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
CodingTool use
CH
Chatty Harry V3.0
Chatty · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
LO
Models LocoreMind LocoOperator 4B
Locooperator · MaziyarPanahi
Params4.02B
Context256K
Q4_K_M2.5 GB
Tool use
MI
Models THU KEG Mistral Crab DPO
Mistral · MaziyarPanahi
Params7.25B
Context32K
Smallest5.0 GB
GGUF
LL
Latxa Llama 3.1 8B Instruct
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
XL
Models Salesforce xLAM 7b Fc R
Xlam · MaziyarPanahi
Params6.91B
Context4K
Smallest4.8 GB
Tool use
LL
Llama 3.1 8b DoberWild v2.02
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
EX
Models LGAI EXAONE EXAONE 3.5 32B Instruct
Exaone · MaziyarPanahi
Params32B
Context32K
Q4_K_M19.3 GB
GGUF

Keep browsing