GGUF models by itlwas
475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.
GE
Gemma 2 2b It
Gemma · itlwas
Params2.61B
Context8K
Q4_K_M1.7 GB
YI
Yi 1.5 34B Chat
Yi · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen2 7B
Qwen · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
Gemma 2 9b It
Gemma · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
SA
Sailor2 20B Chat
Sailor · itlwas
Params19.2B
Context32K
Q4_K_M11.6 GB
QW
Qwen2 0.5B Instruct
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
AZ
Azure Dusk v0.1 Q4 K M
Azure · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen1.5 4B Chat
Qwen · itlwas
Params3.95B
Context32K
Q4_K_M2.5 GB
LL
Llama Deepsync 1B Q4 K M
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
IN
Internlm2_5 1_8b
InternLM · itlwas
Params1.89B
Context32K
Q4_K_M1.2 GB
LD
LDAI-1.5-ANIU
Ldai · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
YA
YandexGPT 5 Lite 8B Pretrain
Yandexgpt · itlwas
Params8.04B
Context32K
Q4_K_M4.9 GB
IN
Internlm2_5 7b Chat
InternLM · itlwas
Params7.74B
Context32K
Q4_K_M4.7 GB
QW
Qwen1.5 32B Chat
Qwen · itlwas
Params32.5B
Context32K
Q4_K_M19.7 GB
MI
Bitnet-Mistral.0.2-47m-v0.1
Mistral · itlwas
Params48M
Context8K
Q4_K_M0.0 GB
OL
AMD OLMo 1B SFT
OLMo · itlwas
Params1.18B
Context2K
Q4_K_M0.7 GB
QW
Qwen2.5 Math 1.5B
Qwen · itlwas
Params1.54B
Context4K
Q4_K_M1.0 GB
IN
Internlm2_5 1_8b Chat
InternLM · itlwas
Params1.89B
Context32K
Q4_K_M1.2 GB
GW
GWQ 9B Preview2
Gwq · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
OP
Openbuddy Yi1.5 34b v21.3 32k
Openbuddy · itlwas
Params34.4B
Context128K
Q4_K_M20.7 GB
VI
Vikhr 7b 0.2
Vikhr · itlwas
Params6.97B
Context2K
Q4_K_M4.2 GB
GR
Granite 3.1 1b A400M Instruct
Granite · itlwas
Params1.33B
Context128K
Q4_K_M0.8 GB
LL
Llama 3.1 Tulu 3 8B DPO Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
AP
Apollo 2B
Apollo · itlwas
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
Qwen1.5 32B
Qwen · itlwas
Params32.5B
Context32K
Q4_K_M19.7 GB
QW
Qwen2.5 7B
Qwen · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
Mistral 7B v0.3
Mistral · itlwas
Params7.25B
Context32K
Q4_K_M4.4 GB
MI
Bitnet-Mistral.0.2-47m-v0.2
Mistral · itlwas
Params48M
Context8K
Q4_K_M0.0 GB
EI
Einstein v6 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
SmolLM 135M
SmolLM · itlwas
Params135M
Context2K
Q4_K_M0.1 GB