GGUF models by MaziyarPanahi

1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
OpenHermes 7B Symbolic
Openhermes · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
GE
models--google--gemma-2b
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-DPO-v0.2
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Commonsense QA Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PH
Phi 3 Context Obedient RAG
Phi · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
SA
Models Sail Sailor2 8B Chat
Sailor · MaziyarPanahi
Params8.55B
Context32K
Q4_K_M5.2 GB
GGUF
MI
dolphin 2.5 mixtral 8x7b
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
CodingTool use
SM
SmolLM 1.7B
SmolLM · MaziyarPanahi
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
MO
models--mergekit-community--mergekit-slerp-oskyrzi
Moistral · MaziyarPanahi
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
ME
MetaMath OpenHermes 2.5 neural chat v3 3 Slerp
Metamath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Hermes 2 Pro 11B
Mistral · MaziyarPanahi
Params11.2B
Context32K
Q4_K_M6.7 GB
Tool use
QW
calme 2.1 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MU
models--automerger--Multi_verse_modelExperiment26-7B
Multi · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
dolphin 2.6 mistral 7b dpo laser
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
MO
models--automerger--T3qm7Strangemerges_32-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Multi_verse_modelExperiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
models--automerger--MergerixStrangemerges_32-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
NeuralHermes 2.5 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
PH
calme 2.3 phi3 4b
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
LL
Llama 3 8B Instruct v0.4
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
MI
models--mergekit-community--mergekit-slerp-kxeioog
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
NY
L3 Nymeria 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
IN
models--automerger--Inex12Experiment28-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
rank zephyr 7b v1 full
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YA
models--automerger--YamT3qm7x-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CA
Calme 7B Instruct v0.4
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EX
models--automerger--Experiment27pasticheT3q-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GR
Models Ibm Granite Granite 3.0 2b Instruct
Granite · MaziyarPanahi
Params2.63B
Context4K
Q4_K_M1.6 GB
Tool use
JA
jaskier 7b dpo v5.6
Jaskier · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZE
models--mergekit-community--mergekit-slerp-xyweuvi
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing