GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
ST
models--automerger--Strangemerges_32Experiment26-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
models--mergekit-community--mergekit-slerp-egyyxzs
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
OpenHermes 2.5 neural chat v3 3 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Models Qwen Qwen2.5 Coder 3B
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
CA
Models prithivMLmods Calcium Opus 14B Elite4
Calcium · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
QW
Qwen2.5 Coder 7B
Qwen · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB
LL
Llama 3.1 8b Medusa v1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
ZE
ZEUS 8B V10
Zeus · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
QW
Models RefalMachine ruadapt_qwen2.5_7B_ext_u48_instruct
Qwen · MaziyarPanahi
Params7.58B
Context32K
Smallest5.3 GB
LL
Models Agentlans Llama3.1 Vodka
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
QW
Models Orion Zhen Qwen2.5 7B Gutenberg KTO
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
MI
MiniCPM4.1 8B
MiniCPM · MaziyarPanahi
Params8.19B
Context64K
Q4_K_M5.0 GB
PA
patricide 12B Unslop Mell
Patricide · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
SU
Models BitStarWalkin SuperCorrect 7B
Supercorrect · MaziyarPanahi
Params7.62B
Context4K
Smallest5.3 GB
LL
Llama3 8B DarkIdol 1.0
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
CO
Iq Code Evmind 7b Instruct v0.2411.0
Code · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
LL
Models Seedboxai Llama 3 KafkaLM 8B v0.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
QW
14B Qwen2.5 Freya x1
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
MI
Models MathGenie MathCoder2 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
LL
Models Deepcogito Cogito v1 Preview Llama 3B
Llama · MaziyarPanahi
Params3.61B
Context128K
Q4_K_M2.2 GB
QW
Models Qwen Qwen2.5 Coder 1.5B
Qwen · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
TR
Models Arcee Ai Trinity Nano Preview
Trinity · MaziyarPanahi
Params6.12B
Context128K
Q4_K_M3.8 GB
CH
chinese text correction 7b
Chinese · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
DR
DRT O1 14B
Drt · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
QW
Qwen2.5 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
GE
Gemma 9B Base
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
MI
v1olet marcoroni go bruins merge 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mini DPO test02 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2 7B
Qwen · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
PO
poemma 12B
Poemma · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB