GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MU
models--automerger--M7Multiverseex26-7B
Multiverseex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
DarkAtom 12B v3
Darkatom · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
UW
UwU 7B Instruct
Uwu · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
MI
Starling LM 11B alpha Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
models--mergekit-community--mergekit-slerp-qamquir
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--Experiment27Shadow-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mini DPO test02
Mini · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-urmzxzt
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MetaMath Tulpar 7b v2 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Yarn Mistral 7b 64k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--Hermes-2-Pro-Llama-3-13B
Llama · MaziyarPanahi
Params12B
Context8K
Q4_K_M7.3 GB
MI
models--mergekit-community--mergekit-slerp-werhsur
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
Dans PersonalityEngine V1.1.0 12b
Dans · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MI
Mistral T5 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
KO
Kosmos EVAA gamma light 8B
Kosmos · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
MI
CatMacaroni Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SH
models--automerger--NeuralsirkrishnaShadow-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
models--mergekit-community--mergekit-slerp-gmjabaw
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
DI
Models Mantis2024 Dirty Shirley Writer v0 Abliterated
Dirty · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
DE
Qwen 1M DeepSeek R1 14B
DeepSeek · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
LL
models--Groq--Llama-3-Groq-70B-Tool-Use
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
QW
Vi Qwen2 7B RAG
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
MI
OpenZephyrChat Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephyr 7b sft full
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral 7B Merge 14 v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Models Vinhnx90 Gemma 3 1b Thinking v2
Gemma · MaziyarPanahi
Params1B
Context32K
Smallest0.8 GB
ST
models--automerger--YamStrangemerges_32-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LO
LongAlign 13B 64k
Longalign · MaziyarPanahi
Params13B
Context64K
Q4_K_M7.9 GB
QW
Models CogBase USTC Qwen2.5 Math 7B Instruct SocraticLM
Qwen · MaziyarPanahi
Params7.62B
Context4K
Smallest5.3 GB
EX
models--automerger--Experiment26Experiment24-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB