GGUF models by qwp4w3hyb

67 GGUF models quantized by qwp4w3hyb on Hugging Face. Sizes run from 1B to 236B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mixtral 8x7B Instruct v0.1 iMat
Mistral · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
CE
Cerebrum 1.0 8x7b iMat
Cerebrum · qwp4w3hyb
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
YI
Yi-1.5-9B-Chat-16K
Yi · qwp4w3hyb
Params8.83B
Context16K
Q4_K_M5.3 GB
GGUF
GE
Gemma 3 1b It
Gemma · qwp4w3hyb
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
QW
Qwen2-1.5B-Instruct
Qwen · qwp4w3hyb
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
GE
gemma-1.1-2b-it
Gemma · qwp4w3hyb
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
ZE
zephyr-orpo-141b-A35b-v0.1
Zephyr · qwp4w3hyb
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
LL
Llama-3-8B-Instruct-Coder-v2
Llama · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
Coding
LL
Meta Llama 3.1 8B Instruct
Llama · qwp4w3hyb
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
SFR-Iterative-DPO-LLaMA-3-8B-R
Llama · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
OP
openchat-3.6-8b-20240522
Openchat · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · qwp4w3hyb
Params236B
Context160K
Smallest47.4 GB
Coding
YI
Yi-1.5-6B-Chat
Yi · qwp4w3hyb
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · qwp4w3hyb
Params9.24B
Context8K
Smallest2.4 GB
GGUF
MI
Nous Hermes 2 Mistral 7B DPO iMat
Mistral · qwp4w3hyb
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
LL
Hermes-2-Pro-Llama-3-8B
Llama · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
LL
Llama-3-11.5B-Instruct-V2
Llama · qwp4w3hyb
Params11.5B
Context8K
Q4_K_M7.0 GB
GGUF
YI
Yi-1.5-34B-Chat-16K
Yi · qwp4w3hyb
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
CO
CodeQwen1.5-7B-Chat
Codeqwen · qwp4w3hyb
Params7.25B
Context64K
Q4_K_M4.7 GB
GGUF
MI
Mistral-22B-v0.1
Mistral · qwp4w3hyb
Params22.2B
Context64K
Q4_K_M13.3 GB
GGUF
YI
Yi-1.5-34B-Chat
Yi · qwp4w3hyb
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
PH
Phi 3 medium 4k instruct iMat
Phi · qwp4w3hyb
Params14B
Context4K
Q4_K_M8.6 GB
Coding
MI
Mistral Small 3.1 24B Instruct 2503 HF
Mistral · qwp4w3hyb
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LL
Llama-3-Instruct-8B-SPPO-Iter3
Llama · qwp4w3hyb
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CO
codegeex4-all-9b
Codegeex · qwp4w3hyb
Params9.4B
Context128K
Smallest3.1 GB
GGUF
WI
wizardcoder-33b-v1.1-mirror
Wizardcoder · qwp4w3hyb
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
QW
Qwen1.5 72B Chat iMat
Qwen · qwp4w3hyb
Params72.3B
Context32K
Q4_K_M43.8 GB
GGUF
LL
Hermes 3 Llama 3.1 8B
Llama · qwp4w3hyb
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
YI
Faro Yi 9B DPO iMat
Yi · qwp4w3hyb
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
GE
gemma-1.1-7b-it
Gemma · qwp4w3hyb
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF

Keep browsing