GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Models Alpindale Llama 3.2 3B
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
GGUF
FA
FastApply 7B v1.0
Fastapply · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
GGUF
HI
Models Hibernates Hiber Multi 10B Instruct
Hiber · MaziyarPanahi
Params10.7B
Context4K
Smallest7.4 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Tool use
MI
samantha mistral 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Models Matrixglitch SD3_prompt Llama_8B
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
PR
Models prithivMLmods Primal Opus 14B Optimus v2
Primal · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
GGUF
CA
Captain Eris Violet GRPO v0.420
Captain · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
SU
L3 8B Sunfall v0.4 Lunar Stheno
Sunfall · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Models NousResearch Llama 3.2 1B
Llama · MaziyarPanahi
Params1.24B
Context128K
Smallest0.9 GB
GGUF
VE
Q2.5 Veltha 14B 0.5
Veltha · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
LL
Llama 3.1 8b Hermedive R1 V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Reasoning
QW
Qwen2.5 7B
Qwen · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
Tool use
MI
Models THU KEG Mistral Crab SFT
Mistral · MaziyarPanahi
Params7.25B
Context32K
Smallest5.0 GB
GGUF
LL
Llama 3.1 8b Smarteaz V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
Kancil V1 llama3 fp16
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
EX
models--automerger--Experiment24Experiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--mergekit-slerp-zwbosgo
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MO
Models Oriental Lab Oriental 1.5b
Models · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
Tool use
CR
Models Catalsyt Corporation Cristal O1 1.5B
Cristal · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
Tool use
WI
models--mergekit-community--mergekit-slerp-jgwqzez
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
AR
Arcee VyLinh
Arcee · MaziyarPanahi
Params3.4B
Context32K
Smallest2.4 GB
Tool use
NE
models--automerger--Experiment26Neuralarjuna-7B
Neuralarjuna · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
MT3 Gen8 gemma 2 9B
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
GGUF
EX
models--automerger--Experiment28Experiment26-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KY
Kyro n1 7B
Kyro · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
GGUF
LL
Llama 3.1 8b DoberWild v2.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
EC
ECE Poirot
Ece · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
Tool use
MO
Models XeTute AURORAV0.3 4B
Models · MaziyarPanahi
Params3.82B
Context128K
Smallest2.6 GB
GGUF
UN
UnslopNemo Mag Mell T 2
Unslopnemo · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF

Keep browsing