GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama Deepsync 1B
Llama · MaziyarPanahi
Params1.24B
Context128K
Smallest0.9 GB
Tool use
BE
BeyondRP 8B
Beyondrp · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
MI
SynthIA 7B v1.3 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 14B Instruct 1M
Qwen · MaziyarPanahi
Params14.8B
Context986K
Smallest10.3 GB
Tool use
LL
Fireball R1.1 Llama 3.1 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ReasoningTool use
VE
Q2.5 Veltha 14B
Veltha · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
MI
models--automerger--T3qExperiment26-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 3B
Qwen · MaziyarPanahi
Params3.4B
Context32K
Smallest2.4 GB
Tool use
AR
Arch Function 3B
Arch · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
Tool use
QW
Qwen2.5 Coder 3B YOYO
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
CodingTool use
QW
Qwen2.5 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
LL
models--mergekit-community--mergekit-slerp-ojqhjfr
Llama · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 8B SuperNova EtherealHermes
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
AB
AbominationScience 12B v4
Abominationscience · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
DR
DRT O1 7B
Drt · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
LL
Models Rhyang2021 Uncertain_Llama3_8B
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
LL
Llama 3.1 8b Hermedive R1 V1.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ReasoningTool use
QW
Qwexit 2.5 14B 2024
Qwexit · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
S1
s1.1 7B
MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
FI
fietje 2 instruct
Fietje · MaziyarPanahi
Params2.78B
Context2K
Smallest1.9 GB
GGUF
FI
Models TheFinAI Fino1 8B
Fino · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
SL
Models Crestf411 MN Slush
Slush · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
YA
models--automerger--YamExperiment24-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 4 Empathetic
Phi · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
GGUF
LL
Llama3.2 3B Esper2
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Tool use
MI
Mistral NeMo Minitron 8B Instruct
Mistral · MaziyarPanahi
Params8.41B
Context8K
Smallest5.9 GB
GGUF
QW
Qwen2.5 7B
Qwen · MaziyarPanahi
Params7.61B
Context128K
Smallest5.3 GB
Tool use
MA
Magellanic Opus 14B Exp
Magellanic · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
LL
Models Nerdyface Llama v1
Llama · MaziyarPanahi
Params1.24B
Context128K
Smallest0.9 GB
Tool use
AE
Models SamuelBang AesCoder 4B
Aescoder · MaziyarPanahi
Params4.41B
Context256K
Q4_K_M2.7 GB
CodingReasoningTool use

Keep browsing