GGUF models by qwp4w3hyb
67 GGUF models quantized by qwp4w3hyb on Hugging Face. Sizes run from 1B to 236B parameters. The longest trained context is 1024K tokens.
MI
Mixtral 8x7B Instruct v0.1 iMat
Mistral · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB
CE
Cerebrum 1.0 8x7b iMat
Cerebrum · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB
YI
Yi-1.5-9B-Chat-16K
Yi · qwp4w3hyb
Params8.83B
Context16K
Q4_K_M5.3 GB
GE
Gemma 3 1b It
Gemma · qwp4w3hyb
Params1B
Context32K
Q4_K_M0.8 GB
QW
Qwen2-1.5B-Instruct
Qwen · qwp4w3hyb
Params1.54B
Context32K
Q4_K_M1.0 GB
GE
gemma-1.1-2b-it
Gemma · qwp4w3hyb
Params2.51B
Context8K
Q4_K_M1.6 GB
ZE
zephyr-orpo-141b-A35b-v0.1
Zephyr · qwp4w3hyb
Params141B
Context64K
Q4_K_M85.6 GB
LL
Llama-3-8B-Instruct-Coder-v2
Llama · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct
Llama · qwp4w3hyb
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
SFR-Iterative-DPO-LLaMA-3-8B-R
Llama · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
OP
openchat-3.6-8b-20240522
Openchat · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · qwp4w3hyb
Params236B
Context160K
Smallest47.4 GB
YI
Yi-1.5-6B-Chat
Yi · qwp4w3hyb
Params6.06B
Context4K
Q4_K_M3.7 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · qwp4w3hyb
Params9.24B
Context8K
Smallest2.4 GB
MI
Nous Hermes 2 Mistral 7B DPO iMat
Mistral · qwp4w3hyb
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Hermes-2-Pro-Llama-3-8B
Llama · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama-3-11.5B-Instruct-V2
Llama · qwp4w3hyb
Params11.5B
Context8K
Q4_K_M7.0 GB
YI
Yi-1.5-34B-Chat-16K
Yi · qwp4w3hyb
Params34.4B
Context16K
Q4_K_M20.7 GB
CO
CodeQwen1.5-7B-Chat
Codeqwen · qwp4w3hyb
Params7.25B
Context64K
Q4_K_M4.7 GB
MI
Mistral-22B-v0.1
Mistral · qwp4w3hyb
Params22.2B
Context64K
Q4_K_M13.3 GB
YI
Yi-1.5-34B-Chat
Yi · qwp4w3hyb
Params34.4B
Context4K
Q4_K_M20.7 GB
PH
Phi 3 medium 4k instruct iMat
Phi · qwp4w3hyb
Params14B
Context4K
Q4_K_M8.6 GB
MI
Mistral Small 3.1 24B Instruct 2503 HF
Mistral · qwp4w3hyb
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
CO
codegeex4-all-9b
Codegeex · qwp4w3hyb
Params9.4B
Context128K
Smallest3.1 GB
WI
wizardcoder-33b-v1.1-mirror
Wizardcoder · qwp4w3hyb
Params33.3B
Context16K
Q4_K_M19.9 GB
QW
Qwen1.5 72B Chat iMat
Qwen · qwp4w3hyb
Params72.3B
Context32K
Q4_K_M43.8 GB
LL
Hermes 3 Llama 3.1 8B
Llama · qwp4w3hyb
Params8.03B
Context128K
Q4_K_M4.9 GB
YI
Faro Yi 9B DPO iMat
Yi · qwp4w3hyb
Params8.83B
Context32K
Q4_K_M5.3 GB
GE
gemma-1.1-7b-it
Gemma · qwp4w3hyb
Params8.54B
Context8K
Q4_K_M5.3 GB