GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MU
models--automerger--M7Multiverseex26-7B
Multiverseex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
DarkAtom 12B v3
Darkatom · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
UW
UwU 7B Instruct
Uwu · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
Tool use
MI
Starling LM 11B alpha Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
models--mergekit-community--mergekit-slerp-qamquir
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
SH
models--automerger--Experiment27Shadow-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mini DPO test02
Mini · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-urmzxzt
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
MetaMath Tulpar 7b v2 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Yarn Mistral 7b 64k Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--Hermes-2-Pro-Llama-3-13B
Llama · MaziyarPanahi
Params12B
Context8K
Q4_K_M7.3 GB
Tool use
MI
models--mergekit-community--mergekit-slerp-werhsur
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
DA
Dans PersonalityEngine V1.1.0 12b
Dans · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
MI
Mistral T5 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KO
Kosmos EVAA gamma light 8B
Kosmos · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
MI
CatMacaroni Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SH
models--automerger--NeuralsirkrishnaShadow-7B
Shadow · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-gmjabaw
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
DI
Models Mantis2024 Dirty Shirley Writer v0 Abliterated
Dirty · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
GGUF
DE
Qwen 1M DeepSeek R1 14B
DeepSeek · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
ReasoningTool use
LL
models--Groq--Llama-3-Groq-70B-Tool-Use
Llama · MaziyarPanahi
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
QW
Vi Qwen2 7B RAG
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
GGUF
MI
OpenZephyrChat Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr 7b sft full
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Merge 14 v0.1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Embedding
GE
Models Vinhnx90 Gemma 3 1b Thinking v2
Gemma · MaziyarPanahi
Params1B
Context32K
Smallest0.8 GB
Reasoning
ST
models--automerger--YamStrangemerges_32-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LO
LongAlign 13B 64k
Longalign · MaziyarPanahi
Params13B
Context64K
Q4_K_M7.9 GB
GGUF
QW
Models CogBase USTC Qwen2.5 Math 7B Instruct SocraticLM
Qwen · MaziyarPanahi
Params7.62B
Context4K
Smallest5.3 GB
GGUF
EX
models--automerger--Experiment26Experiment24-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing