GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
MI
mindy 7b v2
Mindy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Heart Stolen 8B task
Heart · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
MO
moxin llm 7b
Moxin · MaziyarPanahi
Params8.11B
Context32K
Smallest5.6 GB
BA
BADMISTRAL 1.5B
Badmistral · MaziyarPanahi
Params1.55B
Context8K
Smallest1.1 GB
MA
marin 32b base
Marin · MaziyarPanahi
Params32.5B
Context4K
Q4_K_M19.7 GB
DA
DarkIdol LongWriter 8B Uncensored 1048k
Darkidol · MaziyarPanahi
Params8.03B
Context1024K
Smallest5.6 GB
LL
Llama 3.1 8b Dolermed R1 V1.03
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
QW
Qwen 2.5 14B MINUS
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
MI
models--mergekit-community--TopEvolution7RAG
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LO
LongAlpaca 13B 16k
Longalpaca · MaziyarPanahi
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen2.5 7B HomerCreative Mix
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
MI
notux 8x7b v1
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
MI
MISCHIEVOUS 12B Mix 0.5v
Mischievous · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GO
Goppa LogiLlama
Goppa · MaziyarPanahi
Params1.24B
Context128K
Smallest0.9 GB
LL
llama3 8B DarkIdol 2.1 Uncensored 1048K
Llama · MaziyarPanahi
Params8.03B
Context1024K
Smallest5.6 GB
FA
Models Tiiuae Falcon3 1B Base
Falcon · MaziyarPanahi
Params1.67B
Context4K
Smallest1.2 GB
SL
Slush ChatWaifu Chronos
Slush · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
LL
Llama 3.1 8b DodoWild v2.02
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
NA
NaturalLM
Naturallm · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
LL
llama3 8B DarkIdol 1.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
LL
models--mergekit-community--LLaMa-3-Instruct-Zeroed-13B
Llama · MaziyarPanahi
Params13B
Context8K
Q4_K_M7.9 GB
CY
cybertron v4 qw7B MGS
Cybertron · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
LL
Llama 3.1 8b Hermedive V1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
WI
Models Winninghealth WiNGPT Babel
Wingpt · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
ST
models--automerger--Strangemerges_32T3qm7xp-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
FU
MN Funhouse 12B
Funhouse · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
CO
Community Request 01 12B
Community · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
QW
Qwen2.5 Lumen 14B
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
LL
Llama3 8B Aifeifei 1.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
MI
models--mergekit-community--mergekit-slerp-flctqsu
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB