GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 2 7b chat hf function calling v2
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
Tool use
MI
LeoScorpius 7B Chat DPO Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
vigostral 7b chat Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--AgentPublic--LlaMAndement-13b
Llama · MaziyarPanahi
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
TI
TinyMistral 248M SFT v4
Tinymistral · MaziyarPanahi
Params248M
Context32K
Q4_K_M0.2 GB
GGUF
MI
mistral 7b slimorcaboros Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
Yarn Solar 10b 32k
Yarn · MaziyarPanahi
Params10.7B
Context32K
Q4_K_M6.5 GB
Coding
QW
Models Qwen Qwen2.5 Coder 3B Instruct
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
CodingTool use
MI
Mistral CyberLawyer 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
AY
Models lenML Aya Expanse 8b Abliterated
Aya · MaziyarPanahi
Params8.03B
Context8K
Smallest5.7 GB
GGUF
LL
EZO Llama 3.2 3B Instruct dpoE
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
Tool use
LL
Meta Llama 3.1 8B Instruct PRM800K Reasoning
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ReasoningTool use
MI
mistral 7b dpo v6 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Metis 0.4 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
SuperThoughts CoT 14B 16k o1 QwQ
Qwen · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
Reasoning
GR
Models Huihui Ai Granite 3.2 8b Instruct Abliterated
Granite · MaziyarPanahi
Params8.17B
Context128K
Smallest5.6 GB
Tool use
LL
models--mergekit-community--mergekit-passthrough-anunwkh
Llama · MaziyarPanahi
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
LL
Models Meta Llama Llama Guard 3 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
WE
WestSeverus 7B DPO v2
Westseverus · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
SciPhi Self RAG Mistral 7B 32k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
airoboros m 7b 3.1.2 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mistral T5 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VU
Models UCSB SURFI VulnLLM R 7B
Vulnllm · MaziyarPanahi
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
CO
models--mergekit-community--mergekit-slerp-ynceepa
Codegemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
IC
Ice0.101 20.03 RP GRPO 2
Icelemonmedovukharp · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
Roleplay
PR
Prismatic 12b
Prismatic · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
GGUF
ST
StructLM 13B
Structlm · MaziyarPanahi
Params13B
Context16K
Q4_K_M7.9 GB
GGUF
MI
mistral 7b v0.1 layla v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
calme 2.6 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF

Keep browsing