GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llama 3.2 1B
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
AT
Athena 1 1.5B Q4 K M
Athena · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
AH
Ahma 3B
Ahma · itlwas
Params3.63B
Context2K
Q4_K_M2.8 GB
GGUF
AY
Aya 23 8B
Aya · itlwas
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
VI
Vikhr 7B instruct 0.4 Q4 K M
Vikhr · itlwas
Params7.63B
Context32K
Q4_K_M4.6 GB
GGUF
YA
YandexGPT 5 Lite 8B Instruct
Yandexgpt · itlwas
Params8.04B
Context32K
Q4_K_M4.9 GB
Tool use
EX
EXAONE 3.5 7.8B Instruct
Exaone · itlwas
Params7.82B
Context32K
Q4_K_M4.8 GB
GGUF
GE
Gemma 3 12b It
Gemma · itlwas
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen2.5 0.5B Instruct
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
LL
Nous Hermes Llama2 13b
Llama · itlwas
Params13B
Context4K
Q4_K_M7.9 GB
Tool use
QW
Qwen1.5 1.8B Chat
Qwen · itlwas
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
QW
Qwen2 Math 1.5B Instruct
Qwen · itlwas
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
GE
Gemma 2 27b
Gemma · itlwas
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · itlwas
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
QW
Vikhr-Qwen-2.5-0.5b-Instruct
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
SM
SmolLM2 360M
SmolLM · itlwas
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
LL
Llama 3.2 Taiwan 3B Instruct
Llama · itlwas
Params3.61B
Context128K
Q4_K_M2.2 GB
Reasoning
CU
Custom KoLLM 13B v2 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
LL
Llama 3.1 Nemotron 8B UltraLong 4M Instruct Q4 K M
Llama · itlwas
Params8.04B
Context4192K
Q4_K_M4.9 GB
Tool use
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · itlwas
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
AR
Arch Function 7B Q4 K M
Arch · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
BI
BioMistral 7B
Biomistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama SmolTalk 3.2 1B Instruct Q4 K M
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
MA
Magnum v4 22b
Magnum · itlwas
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
SA
Sailor2 8B
Sailor · itlwas
Params8.55B
Context128K
Q4_K_M5.2 GB
Tool use
AU
Aura 4B
Aura · itlwas
Params4.51B
Context128K
Q4_K_M2.8 GB
RoleplayTool use
FA
Falcon3 1B Instruct Abliterated
Falcon · itlwas
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
QW
Qwen2.5 14B
Qwen · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
Tool use
DE
DeepSeek R1 Distill Qwen 14B
DeepSeek · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
PH
Phi 3 Medium 4k Instruct
Phi · itlwas
Params14B
Context4K
Q4_K_M8.6 GB
Coding

Keep browsing