GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
mindy 7b v2
Mindy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Heart Stolen 8B task
Heart · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
MO
moxin llm 7b
Moxin · MaziyarPanahi
Params8.11B
Context32K
Smallest5.6 GB
GGUF
BA
BADMISTRAL 1.5B
Badmistral · MaziyarPanahi
Params1.55B
Context8K
Smallest1.1 GB
GGUF
MA
marin 32b base
Marin · MaziyarPanahi
Params32.5B
Context4K
Q4_K_M19.7 GB
GGUF
DA
DarkIdol LongWriter 8B Uncensored 1048k
Darkidol · MaziyarPanahi
Params8.03B
Context1024K
Smallest5.6 GB
GGUF
LL
Llama 3.1 8b Dolermed R1 V1.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Reasoning
QW
Qwen 2.5 14B MINUS
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
MI
models--mergekit-community--TopEvolution7RAG
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LO
LongAlpaca 13B 16k
Longalpaca · MaziyarPanahi
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen2.5 7B HomerCreative Mix
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
MI
notux 8x7b v1
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
MISCHIEVOUS 12B Mix 0.5v
Mischievous · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
GO
Goppa LogiLlama
Goppa · MaziyarPanahi
Params1.24B
Context128K
Smallest0.9 GB
Tool use
LL
llama3 8B DarkIdol 2.1 Uncensored 1048K
Llama · MaziyarPanahi
Params8.03B
Context1024K
Smallest5.6 GB
GGUF
FA
Models Tiiuae Falcon3 1B Base
Falcon · MaziyarPanahi
Params1.67B
Context4K
Smallest1.2 GB
GGUF
SL
Slush ChatWaifu Chronos
Slush · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
LL
Llama 3.1 8b DodoWild v2.02
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
NA
NaturalLM
Naturallm · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
LL
llama3 8B DarkIdol 1.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
LL
models--mergekit-community--LLaMa-3-Instruct-Zeroed-13B
Llama · MaziyarPanahi
Params13B
Context8K
Q4_K_M7.9 GB
GGUF
CY
cybertron v4 qw7B MGS
Cybertron · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
Tool use
LL
Llama 3.1 8b Hermedive V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
WI
Models Winninghealth WiNGPT Babel
Wingpt · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
GGUF
ST
models--automerger--Strangemerges_32T3qm7xp-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FU
MN Funhouse 12B
Funhouse · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
GGUF
CO
Community Request 01 12B
Community · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
QW
Qwen2.5 Lumen 14B
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
Tool use
LL
Llama3 8B Aifeifei 1.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-flctqsu
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing