GGUF models by MaziyarPanahi
1376 GGUF models quantized by MaziyarPanahi on Hugging Face. Sizes run from 10M to 671B parameters. The longest trained context is 1024K tokens.
OP
OpenHermes 7B Symbolic
Openhermes · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
models--google--gemma-2b
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-DPO-v0.2
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Commonsense QA Mistral 7B Mistral 7B Instruct v0.2 slerp
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
Phi 3 Context Obedient RAG
Phi · MaziyarPanahi
Params3.82B
Context128K
Q4_K_M2.4 GB
SA
Models Sail Sailor2 8B Chat
Sailor · MaziyarPanahi
Params8.55B
Context32K
Q4_K_M5.2 GB
MI
dolphin 2.5 mixtral 8x7b
Mistral · MaziyarPanahi
Params46.7B
Context32K
Q4_K_M28.4 GB
SM
SmolLM 1.7B
SmolLM · MaziyarPanahi
Params1.71B
Context2K
Q4_K_M1.1 GB
MO
models--mergekit-community--mergekit-slerp-oskyrzi
Moistral · MaziyarPanahi
Params7.24B
Context4K
Q4_K_M4.4 GB
ME
MetaMath OpenHermes 2.5 neural chat v3 3 Slerp
Metamath · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Hermes 2 Pro 11B
Mistral · MaziyarPanahi
Params11.2B
Context32K
Q4_K_M6.7 GB
QW
calme 2.1 qwen2 7b
Qwen · MaziyarPanahi
Params7.62B
Context128K
Q4_K_M4.7 GB
MU
models--automerger--Multi_verse_modelExperiment26-7B
Multi · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
dolphin 2.6 mistral 7b dpo laser
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
models--automerger--T3qm7Strangemerges_32-7B
MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Multi_verse_modelExperiment28-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
models--automerger--MergerixStrangemerges_32-7B
Strangemerges · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
NeuralHermes 2.5 Mistral 7B
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PH
calme 2.3 phi3 4b
Phi · MaziyarPanahi
Params3.82B
Context4K
Q4_K_M2.4 GB
LL
Llama 3 8B Instruct v0.4
Llama · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
models--mergekit-community--mergekit-slerp-kxeioog
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
NY
L3 Nymeria 8B
Nymeria · MaziyarPanahi
Params8.03B
Context8K
Q4_K_M4.9 GB
IN
models--automerger--Inex12Experiment28-7B
Inex · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
rank zephyr 7b v1 full
Mistral · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
YA
models--automerger--YamT3qm7x-7B
Yam · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
CA
Calme 7B Instruct v0.4
Calme · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
models--automerger--Experiment27pasticheT3q-7B
Experiment · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GR
Models Ibm Granite Granite 3.0 2b Instruct
Granite · MaziyarPanahi
Params2.63B
Context4K
Q4_K_M1.6 GB
JA
jaskier 7b dpo v5.6
Jaskier · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
ZE
models--mergekit-community--mergekit-slerp-xyweuvi
Zephyr · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB