GGUF models by itlwas
475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.
YU
YuLan Chat 3 12b
Yulan · itlwas
Params11.9B
Context4K
Q4_K_M7.2 GB
QW
Qwen1.5 0.5B
Qwen · itlwas
Params620M
Context32K
Q4_K_M0.4 GB
SA
Sailor 4B Chat
Sailor · itlwas
Params3.95B
Context32K
Q4_K_M2.5 GB
LL
bgGPT llama 3.1 8B Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
SH
Shieldgemma 27b
Shieldgemma · itlwas
Params27.2B
Context8K
Q4_K_M16.6 GB
LL
Llama 3.1 Tulu 3 8B SFT
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.2 1B Instruct
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
SA
Sailor 1.8B Chat
Sailor · itlwas
Params1.84B
Context32K
Q4_K_M1.2 GB
LL
Llama 3.1 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
LI
T lite 0.1 Q4 K M
Lite · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
UW
UwU 14B Math v0.2 Q4 K M
Uwu · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
Gemma 3 R1984 12B
Gemma · itlwas
Params11.8B
Context128K
Q4_K_M7.3 GB
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct Q4 K M
Llama · itlwas
Params8.04B
Context1048K
Q4_K_M4.9 GB
QW
Qwen2.5 0.5B
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
CU
Custom KoLLM 13B v4 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
QW
Qwen2.5 Math 7B
Qwen · itlwas
Params7.62B
Context4K
Q4_K_M4.7 GB
BI
BioMistral 7B TIES Q4 K M
Biomistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
Yi Coder 9B
Coder · itlwas
Params8.83B
Context128K
Q4_K_M5.3 GB
YI
Yi 1.5 6B
Yi · itlwas
Params6.06B
Context4K
Q4_K_M3.7 GB
SA
Sailor-0.5B-Chat
Sailor · itlwas
Params620M
Context32K
Q4_K_M0.4 GB
DE
DeepSeek V2 Lite
DeepSeek · itlwas
Params15.7B
Context160K
Q4_K_M10.4 GB
RE
Reasoning 0.5b Q4 K M
Reasoning · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
QW
QwQ 0.5B Distilled SFT
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
LU
Lusca 33B Q4 K M
Lusca · itlwas
Params33.2B
Context128K
Q4_K_M19.9 GB
GR
Granite 3.1 3b A800M Instruct
Granite · itlwas
Params3.3B
Context128K
Q4_K_M2.0 GB
TR
Triangulum 5B It
Triangulum · itlwas
Params5.41B
Context8K
Q4_K_M3.4 GB
CU
Custom KoLLM 13B v7 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
PH
phi 1 5 Q4 K M
Phi · itlwas
Params1.42B
Context2K
Q4_K_M0.9 GB
OL
AMD OLMo 1B SFT DPO
OLMo · itlwas
Params1.18B
Context2K
Q4_K_M0.7 GB
OR
Orca 2 7b
Orca · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB