GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
models--automerger--Strangemerges_32Experiment26-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
models--mergekit-community--mergekit-slerp-egyyxzs
Wizardmath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
OpenHermes 2.5 neural chat v3 3 Slerp Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Models Qwen Qwen2.5 Coder 3B
Qwen · MaziyarPanahi
Params3.09B
Context32K
Smallest2.2 GB
CodingTool use
CA
Models prithivMLmods Calcium Opus 14B Elite4
Calcium · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
QW
Qwen2.5 Coder 7B
Qwen · MaziyarPanahi
Params7.61B
Context32K
Smallest5.3 GB
CodingTool use
LL
Llama 3.1 8b Medusa v1.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
ZE
ZEUS 8B V10
Zeus · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
QW
Models RefalMachine ruadapt_qwen2.5_7B_ext_u48_instruct
Qwen · MaziyarPanahi
Params7.58B
Context32K
Smallest5.3 GB
Tool use
LL
Models Agentlans Llama3.1 Vodka
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
GGUF
QW
Models Orion Zhen Qwen2.5 7B Gutenberg KTO
Qwen · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
MI
MiniCPM4.1 8B
MiniCPM · MaziyarPanahi
Params8.19B
Context64K
Q4_K_M5.0 GB
Reasoning
PA
patricide 12B Unslop Mell
Patricide · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
SU
Models BitStarWalkin SuperCorrect 7B
Supercorrect · MaziyarPanahi
Params7.62B
Context4K
Smallest5.3 GB
Tool use
LL
Llama3 8B DarkIdol 1.0
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
CO
Iq Code Evmind 7b Instruct v0.2411.0
Code · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
CodingTool use
LL
Models Seedboxai Llama 3 KafkaLM 8B v0.1
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
QW
14B Qwen2.5 Freya x1
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
Tool use
MI
Models MathGenie MathCoder2 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Smallest5.0 GB
Coding
LL
Models Deepcogito Cogito v1 Preview Llama 3B
Llama · MaziyarPanahi
Params3.61B
Context128K
Q4_K_M2.2 GB
ReasoningTool use
QW
Models Qwen Qwen2.5 Coder 1.5B
Qwen · MaziyarPanahi
Params1.54B
Context32K
Smallest1.1 GB
CodingTool use
TR
Models Arcee Ai Trinity Nano Preview
Trinity · MaziyarPanahi
Params6.12B
Context128K
Q4_K_M3.8 GB
Tool use
CH
chinese text correction 7b
Chinese · MaziyarPanahi
Params7.62B
Context32K
Smallest5.3 GB
Tool use
DR
DRT O1 14B
Drt · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
Tool use
QW
Qwen2.5 14B
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
GE
Gemma 9B Base
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
GGUF
MI
v1olet marcoroni go bruins merge 7B Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mini DPO test02 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2 7B
Qwen · MaziyarPanahi
Params7.62B
Context128K
Smallest5.3 GB
GGUF
PO
poemma 12B
Poemma · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use

Keep browsing