GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TH
TheTop 5x7B Instruct S3 v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PL
Models PleIAs Pleias Nano
Pleias · MaziyarPanahi
Params1.2B
Context2K
Q4_K_M0.7 GB
GGUF
EX
models--automerger--Neuralsirkrishnaexperiment26Experiment24-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PA
patricide 12B Unslop Mell v2
Patricide · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
QW
Qwen2.5 14B CIC ACLARC
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
Tool use
MI
Mini DPO test02 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b finetuned orca dpo v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models Qwen Qwen2.5 Coder 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
CodingTool use
MI
Mistral Nemo Prism 12B v7
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
KO
Kosmos EVAA Fusion light 8B
Kosmos · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
X1
x1 7B v0.1
MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
Tool use
MI
models--automerger--T3qM7-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Models Theo77186 Qwen2.5 Coder 7B Instruct 20241106
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
CodingTool use
QW
calme 2.4 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
Models Shibing624 Llama 3 8b Instruct 262k Chinese
Llama · MaziyarPanahi
Params8.03B
Context256K
Smallest5.6 GB
GGUF
HE
HELVETE X
Helvete · MaziyarPanahi
Params10.2B
Context128K
Smallest7.1 GB
Tool use
LL
CodeLlama 34b hf
Llama · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding
RO
Models DavidAU L3.2 Rogue Creative Instruct Uncensored Abliterated 7B
Rogue · MaziyarPanahi
Params7.53B
Context128K
Smallest5.2 GB
Tool use
MO
models--automerger--Experiment26M7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SM
SmolTulu 1.7b Reinforced
Smoltulu · MaziyarPanahi
Params1.71B
Context8K
Smallest1.2 GB
GGUF
MI
mistralopithecus v1 dpo 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
LeoScorpius GreenNode Alpaca 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
models--mergekit-community--Llama-3-8B-666
Llama · MaziyarPanahi
Params12B
Context8K
Q4_K_M7.3 GB
Tool use
MI
openbuddy mistral 7b v13.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
mistral 7b open platypus Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment26Strangemerges_32-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
openbuddy mistral 7b v13 base Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GL
Glowing Forest 2 12B
Glowing · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
IN
Intelligence Agent 7B
Intelligence · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB
GGUF
MI
Mistral Gutenberg Doppel 7B FFT
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF

Keep browsing