GGUF models by itlwas
475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.
FI
Fialka 7B v3
Fialka · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama Guard 3 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
AY
Aya Expanse 8b Abliterated
Aya · itlwas
Params8.03B
Context8K
Q4_K_M5.1 GB
SA
Sailor2 20B
Sailor · itlwas
Params19.2B
Context128K
Q4_K_M11.6 GB
TR
Triangulum 10B It
Triangulum · itlwas
Params10.3B
Context32K
Q4_K_M6.3 GB
DE
Deepseek Math 7b Base
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
SM
SmolLM 360M
SmolLM · itlwas
Params362M
Context2K
Q4_K_M0.3 GB
YI
Yi 1.5 34B
Yi · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
HU
HuatuoGPT O1 7B
Huatuogpt · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
EU
EuroLLM 9B Instruct
Eurollm · itlwas
Params9.15B
Context4K
Q4_K_M5.6 GB
DE
Deepseek Llm 7b Base
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
MI
Mistral Nemo Instruct 2407
Mistral · itlwas
Params12.2B
Context128K
Q4_K_M7.5 GB
AT
Athena 1 0.5B Q4 K M
Athena · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen1.5 4B
Qwen · itlwas
Params3.95B
Context32K
Q4_K_M2.5 GB
MI
Ministral 8B Instruct 2410
Mistral · itlwas
Params8.02B
Context32K
Q4_K_M4.9 GB
LL
Llama 160m
Llama · itlwas
Params162M
Context2K
Q4_K_M0.1 GB
SH
Shieldgemma 9b
Shieldgemma · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen2.5 1.5B
Qwen · itlwas
Params1.78B
Context128K
Q4_K_M1.1 GB
MI
dolphin 2.2 mistral 7b Q4 K M
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Falcon3 3B Instruct Abliterated
Falcon · itlwas
Params3.23B
Context32K
Q4_K_M2.0 GB
SA
Sailor 14B Chat
Sailor · itlwas
Params14.2B
Context32K
Q4_K_M9.2 GB
LL
Llama 7b
Llama · itlwas
Params6.74B
Context2K
Q4_K_M4.1 GB
QW
QwQ LCoT 3B Instruct Q4 K M
Qwen · itlwas
Params3.09B
Context32K
Q4_K_M1.9 GB
LL
Dolphin Llama2 7b
Llama · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Hermes 2 Pro Mistral 7B Q4 K M
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
YU
YuLan Mini
Yulan · itlwas
Params2.42B
Context28K
Q4_K_M1.8 GB
LL
Dolphin Llama 13b
Llama · itlwas
Params13B
Context2K
Q4_K_M7.9 GB
HI
Hiber Multi 10B Instruct
Hiber · itlwas
Params10.7B
Context4K
Q4_K_M6.5 GB
DE
Deepseek Math 7b Rl
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
QW
QWQ 500M Q4 K M
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB