GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
PH
phi 3 portuguese tom cat 4k instruct
Phi · MaziyarPanahi
Params3.82B
Context4K
Smallest2.6 GB
MI
OpenHermes 2.5 neural chat 7b v3 2 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
RA
raspberry 3B
Raspberry · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
QW
calme 3.1 qwenloi 3b
Qwen · MaziyarPanahi
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
Mistral 7b FFT Test3 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Qwen Qwen3 235B A22B Instruct 2507
Qwen · MaziyarPanahi
Params235B
Context256K
Q4_K_M142.2 GB
OL
Models Allenai Olmo 3 7B Think
OLMo · MaziyarPanahi
Params7.3B
Context64K
Q4_K_M4.5 GB
MI
MRAI synatra 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Hush Qwen2.5 7B v1.3
Qwen · MaziyarPanahi
Params7.61B
Context986K
Smallest5.3 GB
FR
fratricide 12B Unslop Mell DARKNESS
Fratricide · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
NI
Ninja V3
Ninja · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
PO
models--ChaoticNeutrals--Poppy_Porpoise-v0.6-L3-8B
Poppy · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Phi 4 QwQ
Qwen · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
LL
Llama 3 8B Stroganoff 4.0
Llama · MaziyarPanahi
Params8.03B
Context10K
Smallest5.6 GB
PH
phi3.5 mini exp 825 uncensored
Phi · MaziyarPanahi
Params3.82B
Context128K
Smallest2.6 GB
CA
Captain Eris Violet Toxic Magnum 12B
Captain · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
SA
models--mergekit-community--mergekit-slerp-aywerbb
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
StructLM 34B
Structlm · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
MI
juanako 7b UNA Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Qwen Qwen2.5 Coder 1.5B Instruct
Qwen · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
PH
phi 2 instruct v0.1
Phi · MaziyarPanahi
Params2.78B
Context2K
Smallest1.9 GB
LL
Models PabloSuaLap Llama 3 8b Chat Reglamentacion V1
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
PH
Phi 3 Medium 4k Instruct
Phi · MaziyarPanahi
Params14B
Context4K
Smallest9.6 GB
MI
PiVoT 10.7B Mistral v0.2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SA
Saul Base
Saul · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SQ
sqlcoder 7b
Sqlcoder · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
models--automerger--YamshadowStrangemerges_32-7B
Yamshadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ME
MeowGPT Ll3
Meowgpt · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
QW
Qwen1.5 MoE A2.7B
Qwen · MaziyarPanahi
Params14.3B
Context8K
Smallest10.2 GB
MI
samantha mistral instruct 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB