GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
EX
models--automerger--Experiment26T3q-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LO
LongAlpaca 13B
Longalpaca · MaziyarPanahi
Params13B
Context4K
Q4_K_M7.9 GB
MI
MistralInstructLongish Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
zephykor ko beta 7b chang Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--Ognoexperiment27M7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
Models Huihui Ai Dria Agent A 3B Abliterated
Models · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
GL
Glowing Forest 12B
Glowing · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
MI
Starling LM 11B alpha Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Rombos Coder V2.5 Qwen 14b
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
OX
oxy 1 small
Oxy · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
QW
Qwen2.5 14B Gutenberg 1e Delta
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
LL
models--mergekit-community--nMer1
Llama · MaziyarPanahi
Params7.24B
Context8K
Q4_K_M4.4 GB
CA
Models prithivMLmods Calcium Opus 14B Elite2
Calcium · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
MI
Mistral Nemo Prism 12B
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
LL
Einstein v6.1 Llama3 8B
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
chinese text correction 1.5b
Chinese · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
QW
Qwen 2.5 7B Exp Sce
Qwen · MaziyarPanahi
Params7.61B
Context986K
Smallest5.3 GB
FA
Fatgirl v2 8B
Fatgirl · MaziyarPanahi
Params8.41B
Context8K
Smallest5.9 GB
FU
FuseQwQen 7B
Fuseqwqen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
YA
models--automerger--YamNeuralsirkrishna-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MA
magnum twilight 12b
Magnum · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
QW
Rombos Coder V2.5 Qwen 7b
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
CH
Chatty Harry V3.0
Chatty · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
LO
Models LocoreMind LocoOperator 4B
Locooperator · MaziyarPanahi
Params4.02B
Context256K
Q4_K_M2.5 GB
MI
Models THU KEG Mistral Crab DPO
Mistral · MaziyarPanahi
Params7.25B
Context32K
Smallest5.0 GB
LL
Latxa Llama 3.1 8B Instruct
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
XL
Models Salesforce xLAM 7b Fc R
Xlam · MaziyarPanahi
Params6.91B
Context4K
Smallest4.8 GB
LL
Llama 3.1 8b DoberWild v2.02
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
EX
Models LGAI EXAONE EXAONE 3.5 32B Instruct
Exaone · MaziyarPanahi
Params32B
Context32K
Q4_K_M19.3 GB