GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
LL
Models Alpindale Llama 3.2 3B
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
FA
FastApply 7B v1.0
Fastapply · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
HI
Models Hibernates Hiber Multi 10B Instruct
Hiber · MaziyarPanahi
Params10.7B
Context4K
Smallest7.4 GB
LL
Llama 3.2 3B Instruct
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
MI
samantha mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Models Matrixglitch SD3_prompt Llama_8B
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
PR
Models prithivMLmods Primal Opus 14B Optimus v2
Primal · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
CA
Captain Eris Violet GRPO v0.420
Captain · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
SU
L3 8B Sunfall v0.4 Lunar Stheno
Sunfall · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Models NousResearch Llama 3.2 1B
Llama · MaziyarPanahi
Params1.24B
Context128K
Smallest0.9 GB
VE
Q2.5 Veltha 14B 0.5
Veltha · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
LL
Llama 3.1 8b Hermedive R1 V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
QW
Qwen2.5 7B
Qwen · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
MI
Models THU KEG Mistral Crab SFT
Mistral · MaziyarPanahi
Params7.25B
Context32K
Smallest5.0 GB
LL
Llama 3.1 8b Smarteaz V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
Kancil V1 llama3 fp16
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
EX
models--automerger--Experiment24Experiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--mergekit-slerp-zwbosgo
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
MO
Models Oriental Lab Oriental 1.5b
Models · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
CR
Models Catalsyt Corporation Cristal O1 1.5B
Cristal · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
WI
models--mergekit-community--mergekit-slerp-jgwqzez
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
AR
Arcee VyLinh
Arcee · MaziyarPanahi
Params3.4B
Context32K
Smallest2.4 GB
NE
models--automerger--Experiment26Neuralarjuna-7B
Neuralarjuna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
MT3 Gen8 gemma 2 9B
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
EX
models--automerger--Experiment28Experiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
KY
Kyro n1 7B
Kyro · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
LL
Llama 3.1 8b DoberWild v2.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
EC
ECE Poirot
Ece · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
MO
Models XeTute AURORAV0.3 4B
Models · MaziyarPanahi
Params3.82B
Context128K
Smallest2.6 GB
UN
UnslopNemo Mag Mell T 2
Unslopnemo · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB