GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
LL
Llama 2 7b chat hf function calling v2
Llama · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
LeoScorpius 7B Chat DPO Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
vigostral 7b chat Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--AgentPublic--LlaMAndement-13b
Llama · MaziyarPanahi
Params13B
Context4K
Q4_K_M7.9 GB
TI
TinyMistral 248M SFT v4
Tinymistral · MaziyarPanahi
Params248M
Context32K
Q4_K_M0.2 GB
MI
mistral 7b slimorcaboros Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
Yarn Solar 10b 32k
Yarn · MaziyarPanahi
Params10.7B
Context32K
Q4_K_M6.5 GB
QW
Models Qwen Qwen2.5 Coder 3B Instruct
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
MI
Mistral CyberLawyer 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
AY
Models lenML Aya Expanse 8b Abliterated
Aya · MaziyarPanahi
Params8.03B
Context8K
Smallest5.7 GB
LL
EZO Llama 3.2 3B Instruct dpoE
Llama · MaziyarPanahi
Params3.21B
Context128K
Smallest2.3 GB
LL
Meta Llama 3.1 8B Instruct PRM800K Reasoning
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
MI
mistral 7b dpo v6 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Metis 0.4 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
SuperThoughts CoT 14B 16k o1 QwQ
Qwen · MaziyarPanahi
Params14.7B
Context16K
Smallest10.2 GB
GR
Models Huihui Ai Granite 3.2 8b Instruct Abliterated
Granite · MaziyarPanahi
Params8.17B
Context128K
Smallest5.6 GB
LL
models--mergekit-community--mergekit-passthrough-anunwkh
Llama · MaziyarPanahi
Params13B
Context8K
Q4_K_M7.9 GB
LL
Models Meta Llama Llama Guard 3 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
WE
WestSeverus 7B DPO v2
Westseverus · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
SciPhi Self RAG Mistral 7B 32k Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.2 Uncensored
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
MI
airoboros m 7b 3.1.2 dare 0.85 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral T5 7B v1 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
VU
Models UCSB SURFI VulnLLM R 7B
Vulnllm · MaziyarPanahi
Params7.62B
Context32K
Q4_K_M4.7 GB
CO
models--mergekit-community--mergekit-slerp-ynceepa
Codegemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
IC
Ice0.101 20.03 RP GRPO 2
Icelemonmedovukharp · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
PR
Prismatic 12b
Prismatic · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
ST
StructLM 13B
Structlm · MaziyarPanahi
Params13B
Context16K
Q4_K_M7.9 GB
MI
mistral 7b v0.1 layla v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
calme 2.6 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB