GGUF models by itlwas
475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.
OP
openchat 3.5 Q4 K M
Openchat · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB
CU
CursedMatrix 8B v9 Q4 K M
Cursedmatrix · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
MI
Mistral Nemo Base 2407
Mistral · itlwas
Params12.2B
Context128K
Q4_K_M7.5 GB
CH
ChatWaifu_v1.4
Chatwaifu · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
KO
Kosmos 8B v1 Q4 K M
Kosmos · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 32B
Qwen · itlwas
Params32.8B
Context128K
Q4_K_M19.9 GB
SM
SmolLM 1.7B Instruct Q4 K M
SmolLM · itlwas
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM 135M
SmolLM · itlwas
Params135M
Context2K
Q4_K_M0.1 GB
IN
Internlm2 Math 7b
InternLM · itlwas
Params7.74B
Context8K
Q4_K_M4.7 GB
GH
Ghost 8b Beta 1608
Ghost · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
CH
ChatYuan 7B
Chatyuan · itlwas
Params6.74B
Context2K
Q4_K_M4.1 GB
IN
Internlm2_5 20b
InternLM · itlwas
Params19.9B
Context256K
Q4_K_M12.0 GB
BI
BioMistral 7B DARE Q4 K M
Biomistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GW
GWQ2b Q4 K M
Gwq · itlwas
Params2.61B
Context8K
Q4_K_M1.7 GB
AC
AceGPT v2 32B
Acegpt · itlwas
Params32.5B
Context32K
Q4_K_M19.7 GB
AW
AwA 1.5B Q4 K M
Awa · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
EX
EXAONE Deep 7.8B
Exaone · itlwas
Params7.82B
Context32K
Q4_K_M4.8 GB
GR
Granite 3.0 1b A400M Base
Granite · itlwas
Params1.38B
Context4K
Q4_K_M0.9 GB
OL
OLMo 2 1124 13B
OLMo · itlwas
Params13.7B
Context4K
Q4_K_M8.4 GB
YI
EVA Yi 1.5 9B 32K V1 Q4 K M
Yi · itlwas
Params8.83B
Context32K
Q4_K_M5.3 GB
AP
Apollo 0.5B
Apollo · itlwas
Params464M
Context32K
Q4_K_M0.3 GB
GE
saiga gemma2 9b Q4 K M
Gemma · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
CU
Custom KoLLM 13B v5 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
YI
Yi 1.5 9B
Yi · itlwas
Params8.83B
Context12K
Q4_K_M5.3 GB
QW
Qwen2 Math 1.5B
Qwen · itlwas
Params1.54B
Context4K
Q4_K_M1.0 GB
SA
Sailor 4B
Sailor · itlwas
Params3.95B
Context32K
Q4_K_M2.5 GB
MI
Mistral Small Instruct 2409
Mistral · itlwas
Params22.2B
Context32K
Q4_K_M13.3 GB
FA
Falcon3 1B Base
Falcon · itlwas
Params1.67B
Context4K
Q4_K_M1.1 GB
EX
EXAONE Deep 2.4B
Exaone · itlwas
Params2.41B
Context32K
Q4_K_M1.5 GB
OP
openchat v3.2 super Q4 K M
Openchat · itlwas
Params13B
Context4K
Q4_K_M7.9 GB