GGUF models by itlwas
475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.
CH
ChatWaifu_v1.2.1
Chatwaifu · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
TR
Trillion 7B Preview
Trillion · itlwas
Params7.53B
Context4K
Q4_K_M4.6 GB
MA
Marco o1 Q4 K M
Marco · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
VI
Vikhr tiny 0.1 Q4 K M
Vikhr · itlwas
Params2.78B
Context2K
Q4_K_M1.9 GB
GW
GWQ 9B Preview
Gwq · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
EI
Einstein v3 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi 1.5 9B
Yi · itlwas
Params8.83B
Context4K
Q4_K_M5.3 GB
SA
Sailor2 8B Chat
Sailor · itlwas
Params8.55B
Context32K
Q4_K_M5.2 GB
NI
NightyGurps 14b v1.1 Q4 K M
Nightygurps · itlwas
Params14.8B
Context32K
Q4_K_M9.0 GB
UW
UwU 7B Instruct Q4 K M
Uwu · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
SA
Sailor 7B
Sailor · itlwas
Params7.72B
Context32K
Q4_K_M4.8 GB
HU
HuatuoGPT2 7B
Huatuogpt · itlwas
Params7.51B
Context4K
Q4_K_M4.6 GB
CU
Custom KoLLM 13B v3 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
PO
poemma 12B Q4 K M
Poemma · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen2 7B Instruct
Qwen · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
QV
QVikhr 2.5 1.5B Instruct r Q4 K M
Qvikhr · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
FA
Falcon3 1B Instruct
Falcon · itlwas
Params1.67B
Context8K
Q4_K_M1.1 GB
VI
Vikhr 7B Instruct_0.2
Vikhr · itlwas
Params6.97B
Context2K
Q4_K_M4.2 GB
OM
OmniLing V1 12b experimental Q4 K M
Omniling · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen2 Math 7B
Qwen · itlwas
Params7.62B
Context4K
Q4_K_M4.7 GB
TI
TinyLlama_v1.1_math_code
Tinyllama · itlwas
Params1.1B
Context2K
Q4_K_M0.7 GB
EX
EXAONE 3.5 2.4B Instruct
Exaone · itlwas
Params2.41B
Context32K
Q4_K_M1.5 GB
SA
Sailor 1.8B
Sailor · itlwas
Params1.84B
Context8K
Q4_K_M1.2 GB
LL
YuLan LLaMA 2 13b
Llama · itlwas
Params13.2B
Context8K
Q4_K_M8.0 GB
QW
Qwen2 0.5B
Qwen · itlwas
Params494M
Context128K
Q4_K_M0.4 GB
LL
Llama 3.2 Kapusta 3B v8
Llama · itlwas
Params3.61B
Context128K
Q4_K_M2.2 GB
QW
Qwen2 Math 7B Instruct
Qwen · itlwas
Params7.62B
Context4K
Q4_K_M4.7 GB
VI
Vicuna 7b v1.5
Vicuna · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
NE
Neo_7B_Instruct_V0.1
Neo · itlwas
Params7.79B
Context8K
Q4_K_M4.7 GB
AH
Ahma 7B Instruct
Ahma · itlwas
Params7B
Context2K
Q4_K_M4.3 GB