GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
EU
Models PRIME RL Eurus 2 7B PRIME
Eurus · MaziyarPanahi
Params7.62B
Context4K
Smallest5.3 GB
GGUF
MI
v1olet merged dpo 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 Hawkish 8B
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
MI
Models Miromind Ai MiroThinker v1.0 8B
Mirothinker · MaziyarPanahi
Params8.19B
Context256K
Q4_K_M5.0 GB
ReasoningTool use
MI
models--mergekit-community--TopEvolution
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
Models Meta Llama Llama Guard 3 1B
Llama · MaziyarPanahi
Params1.5B
Context128K
Smallest1.1 GB
GGUF
QW
Qwen2.5 14B YOYO
Qwen · MaziyarPanahi
Params14.8B
Context128K
Smallest10.3 GB
Tool use
SC
Models Inference Net Schematron 3B
Schematron · MaziyarPanahi
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Hush Qwen2.5 7B RP v1.4 1M
Qwen · MaziyarPanahi
Params7.61B
Context986K
Smallest5.3 GB
RoleplayTool use
QW
qwen 2.5 7B DPO split1 16bit chunk34
Qwen · MaziyarPanahi
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
NE
nepoticide 12B Unslop Unleashed Mell RPMax v2
Nepoticide · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
MA
magnum v4 12b
Magnum · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
Tool use
LL
Llama 3 8B Stroganoff 3.0
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
DA
DARE TIES 13B
Dare · MaziyarPanahi
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
GR
MN GRAND Gutenberg Lyra4 Lyra 12B MADNESS
Grand · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
LL
Llama 3.1 8b DodoWild v2.01
Llama · MaziyarPanahi
Params8.03B
Context128K
Smallest5.6 GB
Tool use
QW
Qwen2.5 14B CIC SciCite
Qwen · MaziyarPanahi
Params14.8B
Context32K
Smallest10.3 GB
Tool use
MI
models--mergekit-community--mergekit-slerp-bjlsrkr
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 1.5B YOYO
Qwen · MaziyarPanahi
Params1.54B
Context128K
Smallest1.1 GB
Tool use
AL
models--automerger--AlloyingotneoyExperiment28-7B
Alloyingotneoy · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LW
LWM Text 256K
Lwm · MaziyarPanahi
Params6.74B
Context256K
Q4_K_M4.1 GB
GGUF
MI
BioMistral 7B TIES
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OL
Models Allenai Olmo 3 7B Instruct
OLMo · MaziyarPanahi
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
QW
Models RefalMachine ruadapt_qwen2.5_3B_ext_u48_instruct_v4
Qwen · MaziyarPanahi
Params3.08B
Context32K
Smallest2.2 GB
Tool use
SA
SAINEMO reMIX
Sainemo · MaziyarPanahi
Params12.2B
Context1000K
Smallest8.5 GB
GGUF
WA
Models RicardoLee WASSA2024_EmpathyDetection_Chinchunmei_EXP305
Wassa · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
GGUF
LL
Models Mlx Community Llama 3 Groq 8B Tool Use Bf16
Llama · MaziyarPanahi
Params8.03B
Context8K
Smallest5.6 GB
Tool use
MI
Mistral Nemo VICIOUS MESH 12B 2407
Mistral · MaziyarPanahi
Params12.2B
Context128K
Smallest8.5 GB
Tool use
MI
Misted 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
quantum v0.01 Mistral 7B Instruct v0.1
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing