GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
LL
Llama Deepsync 1B
Llama · MaziyarPanahi
Params1.24B
Context128K
Smallest0.9 GB
BE
BeyondRP 8B
Beyondrp · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
MI
SynthIA 7B v1.3 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 14B Instruct 1M
Qwen · MaziyarPanahi
Params14.8B
Context986K
Smallest10.3 GB
LL
Fireball R1.1 Llama 3.1 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
VE
Q2.5 Veltha 14B
Veltha · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
MI
models--automerger--T3qExperiment26-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 3B
Qwen · MaziyarPanahi
Params3.4B
Context32K
Smallest2.4 GB
AR
Arch Function 3B
Arch · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
QW
Qwen2.5 Coder 3B YOYO
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
QW
Qwen2.5 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
LL
models--mergekit-community--mergekit-slerp-ojqhjfr
Llama · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Llama 3.1 8B SuperNova EtherealHermes
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
AB
AbominationScience 12B v4
Abominationscience · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
DR
DRT O1 7B
Drt · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
LL
Models Rhyang2021 Uncertain_Llama3_8B
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
LL
Llama 3.1 8b Hermedive R1 V1.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
QW
Qwexit 2.5 14B 2024
Qwexit · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
S1
s1.1 7B
MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
FI
fietje 2 instruct
Fietje · MaziyarPanahi
Params2.78B
Context2K
Smallest1.9 GB
FI
Models TheFinAI Fino1 8B
Fino · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
SL
Models Crestf411 MN Slush
Slush · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
YA
models--automerger--YamExperiment24-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Phi 4 Empathetic
Phi · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
LL
Llama3.2 3B Esper2
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
MI
Mistral NeMo Minitron 8B Instruct
Mistral · MaziyarPanahi
Params8.41B
Context8K
Smallest5.9 GB
QW
Qwen2.5 7B
Qwen · MaziyarPanahi
Params7.61B
Context128K
Smallest5.3 GB
MA
Magellanic Opus 14B Exp
Magellanic · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
LL
Models Nerdyface Llama v1
Llama · MaziyarPanahi
Params1.24B
Context128K
Smallest0.9 GB
AE
Models SamuelBang AesCoder 4B
Aescoder · MaziyarPanahi
Params4.41B
Context256K
Q4_K_M2.7 GB