GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
models--mergekit-community--Superevolution
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Qwen2.5 Coder 0.5B QwQ draft
Qwen · MaziyarPanahi
Params494M
Context32K
Smallest0.4 GB
CodingReasoningTool use
MI
MythoMist 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MY
models--automerger--MyriadStrangemerges_32-7B
Myriad · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
models--mergekit-community--mergekit-slerp-lvhhlmq
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
TE
TEST2 Q2.5 Lenned 14B
Test · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
MI
Mistral 11B OmniMix Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
zephyr beta math Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment29Multi_verse_model-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AL
models--AgentPublic--albertlight-7b
Albertlight · MaziyarPanahi
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
BI
BioMedGPT LM 7B
Biomedgpt · MaziyarPanahi
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Mistral 7b FFT Test3 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
samantha 1.2 mistral 7b Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
VI
MN Violet Lotus 12B
Violet · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
Tool use
MI
tiledfloor Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openchat 3.5 1210
Mistral · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
RE
ReasonFlux F1 7B
Reasonflux · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
ReasoningTool use
MI
openbuddy mistral 7b v13 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MixTAO 7Bx2 MoE Instruct v7.0
Mixtao · MaziyarPanahi
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
MI
OpenHermes 2.5 neural chat 7b v3 1 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
bagel dpo 7b v0.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llama3 8B DarkIdol 2.3 Uncensored 32K
Llama · MaziyarPanahi
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
models--AgentPublic--LlaMAndement-7b
Llama · MaziyarPanahi
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
merlinite 7b
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models Huihui Ai Qwen2.5 Coder 7B Instruct Abliterated
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
CodingTool use
NY
L3 Nymeria Maid 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
una cybertron 7b v3 OMA Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OPEN SOLAR KO 10.7B
Open · MaziyarPanahi
Params10.9B
Context2K
Q4_K_M6.5 GB
GGUF
OG
models--automerger--Strangemerges_32Ogno-7B
Ogno · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KU
models--mergekit-community--Evolver
Kunoichi · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing