GGUF models by itlwas
475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.
DE
DeepSeek R1 Distill Llama 8B
DeepSeek · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
FA
Falcon3 10B Instruct Abliterated
Falcon · itlwas
Params10.3B
Context32K
Q4_K_M6.3 GB
QW
Qwen1.5 14B Chat
Qwen · itlwas
Params14.2B
Context32K
Q4_K_M9.2 GB
AU
Aura MoE 2x4B v2
Aura · itlwas
Params7.23B
Context128K
Q4_K_M4.4 GB
LL
Meta Llama Guard 2 8B
Llama · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
LL
LLaMA 2 13b GTL Delta Q4 K M
Llama · itlwas
Params13B
Context2K
Q4_K_M7.9 GB
TR
Triangulum 1B
Triangulum · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
PH
Einstein v6.1 phi2 Q4 K M
Phi · itlwas
Params2.78B
Context2K
Q4_K_M1.7 GB
SA
Sailor2 1B Chat
Sailor · itlwas
Params988M
Context32K
Q4_K_M0.7 GB
DE
DeepSeek R1 Distill Qwen 32B
DeepSeek · itlwas
Params32.8B
Context128K
Q4_K_M19.9 GB
IN
Internlm2_5 20b Chat
InternLM · itlwas
Params19.9B
Context32K
Q4_K_M12.0 GB
LL
Llama 3.2 1B
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
Mixtral 8x7B Instruct v0.1
Mistral · itlwas
Params46.7B
Context32K
Q4_K_M28.4 GB
SH
Shieldgemma 2b
Shieldgemma · itlwas
Params2.61B
Context8K
Q4_K_M1.7 GB
SM
SmolLM 1.7B
SmolLM · itlwas
Params1.71B
Context2K
Q4_K_M1.1 GB
FI
Fialka 7B v2.1
Fialka · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
TR
Triangulum 10B
Triangulum · itlwas
Params10.3B
Context32K
Q4_K_M6.3 GB
PH
Einstein v4 phi2 Q4 K M
Phi · itlwas
Params2.78B
Context2K
Q4_K_M1.7 GB
OP
OpenCoder 8B Instruct
Opencoder · itlwas
Params7.77B
Context8K
Q4_K_M4.7 GB
GE
Gemma 2 9b
Gemma · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
CU
Custom KoLLM 13B v8 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
LL
llama 3 8b gpt 4o ru1.0 Q4 K M
Llama · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
AV
Ava 1.0 12B Q4 K M
Ava · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Sailor-0.5B
Qwen · itlwas
Params620M
Context32K
Q4_K_M0.4 GB
SM
SmolLM2 1.7B Instruct
SmolLM · itlwas
Params1.71B
Context8K
Q4_K_M1.1 GB
LL
Llama 3.2 Kapusta JapanChibi 3B v1
Llama · itlwas
Params3.61B
Context128K
Q4_K_M2.2 GB
MI
Mixtral 8x7B v0.1
Mistral · itlwas
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
LLaMA 2 7b GTL Delta Q4 K M
Llama · itlwas
Params6.74B
Context2K
Q4_K_M4.1 GB
LL
Llama 3.1 Tulu 2 8b
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen1.5 7B
Qwen · itlwas
Params7.72B
Context32K
Q4_K_M4.8 GB