GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
TH
TheTop 5x7B Instruct S3 v0.1
Thetop · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PL
Models PleIAs Pleias Nano
Pleias · MaziyarPanahi
Params1.2B
Context2K
Q4_K_M0.7 GB
EX
models--automerger--Neuralsirkrishnaexperiment26Experiment24-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
patricide 12B Unslop Mell v2
Patricide · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
QW
Qwen2.5 14B CIC ACLARC
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
MI
Mini DPO test02 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b finetuned orca dpo v2 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Qwen Qwen2.5 Coder 7B Instruct
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
MI
Mistral Nemo Prism 12B v7
Mistral · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
KO
Kosmos EVAA Fusion light 8B
Kosmos · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
X1
x1 7B v0.1
MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
MI
models--automerger--T3qM7-7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Theo77186 Qwen2.5 Coder 7B Instruct 20241106
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
QW
calme 2.4 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
Models Shibing624 Llama 3 8b Instruct 262k Chinese
Llama · MaziyarPanahi
Params8.03B
Context256K
Smallest5.6 GB
HE
HELVETE X
Helvete · MaziyarPanahi
Params10.2B
Context128K
Smallest7.1 GB
LL
CodeLlama 34b hf
Llama · MaziyarPanahi
Params33.7B
Context16K
Q4_K_M20.2 GB
RO
Models DavidAU L3.2 Rogue Creative Instruct Uncensored Abliterated 7B
Rogue · MaziyarPanahi
Params7.53B
Context128K
Smallest5.2 GB
MO
models--automerger--Experiment26M7-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolTulu 1.7b Reinforced
Smoltulu · MaziyarPanahi
Params1.71B
Context8K
Smallest1.2 GB
MI
mistralopithecus v1 dpo 7b Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
LeoScorpius GreenNode Alpaca 7B v1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
models--mergekit-community--Llama-3-8B-666
Llama · MaziyarPanahi
Params12B
Context8K
Q4_K_M7.3 GB
MI
openbuddy mistral 7b v13.1 Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
mistral 7b open platypus Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment26Strangemerges_32-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
openbuddy mistral 7b v13 base Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
Glowing Forest 2 12B
Glowing · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
IN
Intelligence Agent 7B
Intelligence · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB
MI
Mistral Gutenberg Doppel 7B FFT
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB