GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
PH
phi 3 portuguese tom cat 4k instruct
Phi · MaziyarPanahi
Params3.82B
Context4K
Smallest2.6 GB
GGUF
MI
OpenHermes 2.5 neural chat 7b v3 2 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
RA
raspberry 3B
Raspberry · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
Tool use
QW
calme 3.1 qwenloi 3b
Qwen · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
MI
Mistral 7b FFT Test3 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models Qwen Qwen3 235B A22B Instruct 2507
Qwen · MaziyarPanahi
Params235B
Context256K
Q4_K_M142.2 GB
ReasoningTool use
OL
Models Allenai Olmo 3 7B Think
OLMo · MaziyarPanahi
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
MI
MRAI synatra 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Hush Qwen2.5 7B v1.3
Qwen · MaziyarPanahi
Params7.61B
Context986K
Smallest5.3 GB
Tool use
FR
fratricide 12B Unslop Mell DARKNESS
Fratricide · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
NI
Ninja V3
Ninja · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
PO
models--ChaoticNeutrals--Poppy_Porpoise-v0.6-L3-8B
Poppy · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Phi 4 QwQ
Qwen · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
Reasoning
LL
Llama 3 8B Stroganoff 4.0
Llama · MaziyarPanahi
Params8.03B
Context10K
Smallest5.6 GB
GGUF
PH
phi3.5 mini exp 825 uncensored
Phi · MaziyarPanahi
Params3.82B
Context128K
Smallest2.6 GB
GGUF
CA
Captain Eris Violet Toxic Magnum 12B
Captain · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
SA
models--mergekit-community--mergekit-slerp-aywerbb
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
StructLM 34B
Structlm · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
GGUF
MI
juanako 7b UNA Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models Qwen Qwen2.5 Coder 1.5B Instruct
Qwen · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
CodingTool use
PH
phi 2 instruct v0.1
Phi · MaziyarPanahi
Params2.78B
Context2K
Smallest1.9 GB
GGUF
LL
Models PabloSuaLap Llama 3 8b Chat Reglamentacion V1
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
PH
Phi 3 Medium 4k Instruct
Phi · MaziyarPanahi
Params14B
Context4K
Smallest9.6 GB
GGUF
MI
PiVoT 10.7B Mistral v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SA
Saul Base
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SQ
sqlcoder 7b
Sqlcoder · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
YA
models--automerger--YamshadowStrangemerges_32-7B
Yamshadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ME
MeowGPT Ll3
Meowgpt · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
QW
Qwen1.5 MoE A2.7B
Qwen · MaziyarPanahi
Params14.3B
Context8K
Smallest10.2 GB
GGUF
MI
samantha mistral instruct 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing