GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
QW
UltraQwen 7B
Qwen · MaziyarPanahi
Params7.72B
Context32K
Q4_K_M4.8 GB
EX
models--automerger--Experiment26Inex12-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Models Tiiuae Falcon3 3B Instruct
Falcon · MaziyarPanahi
Params3.23B
Context32K
Smallest2.3 GB
DA
DarkCamelot 2
Darkcamelot · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
LL
llama3 8B cn rochat v1
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
AN
AngelSlayer 12B Unslop Mell RPMax DARKNESS
Angelslayer · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
LL
Models Chainbase Labs Theia Llama 3.1 8B v1.1
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
KO
Kosmos Elusive VENN Aurora faustus 8B
Kosmos · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
LL
Models NousResearch Meta Llama 3.1 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
models--mergekit-community--mergekit-slerp-mkzyzjw
Llama · MaziyarPanahi
Params8.03B
Context512K
Q4_K_M4.9 GB
IN
MN 12B Inferor v0.1
Inferor · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
MA
Magic 8B
Magic · MaziyarPanahi
Params8.41B
Context8K
Smallest5.9 GB
IC
Ice0.101 20.03 RP
Ice · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
SE
Sensei 7B V1
Sensei · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MistralNemoTiny
Mistral · MaziyarPanahi
Params4.61B
Context1000K
Smallest3.3 GB
LL
Reasoning Llama 1b v0.1
Llama · MaziyarPanahi
Params1.24B
Context128K
Smallest0.9 GB
EX
models--automerger--Experiment28Strangemerges_32-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 Coder 1.5B
Qwen · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
MI
Mini Synatra SFT Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
MN Hekate Enodia 12B
Hekate · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MO
Models Huihui Ai Dria Agent A 7B Abliterated
Models · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
IN
models--automerger--Inex12Yamshadowexperiment28-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
Models DavidAU DeepSeek Grand Horror SMB R1 Distill Llama 3.1 16B
DeepSeek · MaziyarPanahi
Params15.7B
Context128K
Smallest10.8 GB
SO
Models prithivMLmods Sombrero Opus 14B Elite6
Sombrero · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
MI
Flammades Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
MI
Marcoroni neural chat 7B v2 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
openchat 3.6 8b 20240522
Openchat · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
MI
S1 4o mini
Mini · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
CO
CosmicBun 8B
Cosmicbun · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
CU
cursa o1 7b v1.1
Cursa · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB