GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
UltraQwen 7B
Qwen · MaziyarPanahi
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
EX
models--automerger--Experiment26Inex12-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
Models Tiiuae Falcon3 3B Instruct
Falcon · MaziyarPanahi
Params3.23B
Context32K
Smallest2.3 GB
GGUF
DA
DarkCamelot 2
Darkcamelot · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
LL
llama3 8B cn rochat v1
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
AN
AngelSlayer 12B Unslop Mell RPMax DARKNESS
Angelslayer · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
LL
Models Chainbase Labs Theia Llama 3.1 8B v1.1
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
KO
Kosmos Elusive VENN Aurora faustus 8B
Kosmos · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
LL
Models NousResearch Meta Llama 3.1 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
LL
models--mergekit-community--mergekit-slerp-mkzyzjw
Llama · MaziyarPanahi
Params8.03B
Context512K
Q4_K_M4.9 GB
GGUF
IN
MN 12B Inferor v0.1
Inferor · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
Tool use
MA
Magic 8B
Magic · MaziyarPanahi
Params8.41B
Context8K
Smallest5.9 GB
GGUF
IC
Ice0.101 20.03 RP
Ice · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
Roleplay
SE
Sensei 7B V1
Sensei · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
MistralNemoTiny
Mistral · MaziyarPanahi
Params4.61B
Context1000K
Smallest3.3 GB
Tool use
LL
Reasoning Llama 1b v0.1
Llama · MaziyarPanahi
Params1.24B
Context128K
Smallest0.9 GB
Reasoning
EX
models--automerger--Experiment28Strangemerges_32-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 Coder 1.5B
Qwen · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
CodingTool use
MI
Mini Synatra SFT Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
MN Hekate Enodia 12B
Hekate · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
MO
Models Huihui Ai Dria Agent A 7B Abliterated
Models · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
IN
models--automerger--Inex12Yamshadowexperiment28-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
Models DavidAU DeepSeek Grand Horror SMB R1 Distill Llama 3.1 16B
DeepSeek · MaziyarPanahi
Params15.7B
Context128K
Smallest10.8 GB
ReasoningTool use
SO
Models prithivMLmods Sombrero Opus 14B Elite6
Sombrero · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
MI
Flammades Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
GGUF
MI
Marcoroni neural chat 7B v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
openchat 3.6 8b 20240522
Openchat · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
MI
S1 4o mini
Mini · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
CO
CosmicBun 8B
Cosmicbun · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
CU
cursa o1 7b v1.1
Cursa · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB
Tool use

Keep browsing