GGUF models by itlwas
475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.
MI
Mistral-7B-Instruct-v0.2
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
AH
Ahma 3B Instruct
Ahma · itlwas
Params3.63B
Context2K
Q4_K_M2.8 GB
QW
Qwen1.5 1.8B
Qwen · itlwas
Params1.84B
Context32K
Q4_K_M1.2 GB
PH
phi 1 Q4 K M
Phi · itlwas
Params1.42B
Context2K
Q4_K_M0.9 GB
GR
Granite 3.1 2b Instruct
Granite · itlwas
Params2.53B
Context128K
Q4_K_M1.5 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · itlwas
Params7.82B
Context4K
Q4_K_M4.8 GB
CO
Codepy Deepthink 3B Q4 K M
Codepy · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen2.5 32B Instruct
Qwen · itlwas
Params32.8B
Context32K
Q4_K_M19.9 GB
MI
Dolphin 2.6 Mistral 7b
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 1.7B
Qwen · itlwas
Params2.03B
Context40K
Q4_K_M1.3 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · itlwas
Params1.54B
Context4K
Q4_K_M1.0 GB
QW
Qwen2.5 1.5B
Qwen · itlwas
Params1.54B
Context128K
Q4_K_M1.0 GB
VI
Vikhr 7b 0.1
Vikhr · itlwas
Params7.31B
Context32K
Q4_K_M4.4 GB
LL
Llama Guard 3 1B
Llama · itlwas
Params1.5B
Context128K
Q4_K_M1.0 GB
LL
llama 3 8b gpt 4o Q4 K M
Llama · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.2 Taiwan 3B Q4 K M
Llama · itlwas
Params3.61B
Context128K
Q4_K_M2.2 GB
VI
Violet Twilight v0.2 Q4 K M
Violet · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
OP
openchat 3.5 0106 Q4 K M
Openchat · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB
SA
SAINEMO reMIX Q4 K M
Sainemo · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3 14B Base
Qwen · itlwas
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Dolphin 2.9 Llama3 8b 1m
Llama · itlwas
Params8.03B
Context1024K
Q4_K_M4.9 GB
QW
Qwen2 1.5B Instruct
Qwen · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama 3.1 8B Lexi Uncensored Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 Tulu 3 8B Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
LL
Llama 600M Rus
Llama · itlwas
Params548M
Context2K
Q4_K_M0.4 GB
AC
AceGPT v2 8B Chat
Acegpt · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen2.5 7B Instruct
Qwen · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Nous Hermes Llama 2 7b
Llama · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
TR
Triangulum 5B
Triangulum · itlwas
Params5.41B
Context8K
Q4_K_M3.4 GB
AP
Apollo 6B
Apollo · itlwas
Params6.06B
Context4K
Q4_K_M3.7 GB