GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Sailor 7B Chat
Sailor · itlwas
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
AT
Athena 1 7B Q4 K M
Athena · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
FA
Falcon3 7B Instruct Abliterated
Falcon · itlwas
Params7.46B
Context32K
Q4_K_M4.6 GB
Tool use
QW
Qwen3 14B
Qwen · itlwas
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
QW
Qwen2.5 7B
Qwen · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
MI
dolphin 2.1 mistral 7b Q4 K M
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 1.5 6B Chat
Yi · itlwas
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
EI
Einstein Openchat 7B
Einstein · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
LL
LlamaGuard 7b
Llama · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Skywork O1 Open Llama3.1 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
CO
Yi Coder 1.5B
Coder · itlwas
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
LL
Sebushka llama 3.1 8B Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AP
Apollo 34B
Apollo · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
NE
NekoMix 12B Q4 K M
Nekomix · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
AP
Apollo 7B
Apollo · itlwas
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
SA
saiga tlite 8b Q4 K M
Saiga · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
Deepseek Math 7b Instruct
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
CO
Cosmo 1b
Cosmo · itlwas
Params1.74B
Context2K
Q4_K_M1.1 GB
GGUF
YU
YuLan Base 12b
Yulan · itlwas
Params11.9B
Context4K
Q4_K_M7.2 GB
GGUF
AC
AceGPT v2 32B Chat
Acegpt · itlwas
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
GR
Granite 3.1 3b A800M Base
Granite · itlwas
Params3.3B
Context128K
Q4_K_M2.0 GB
GGUF
CR
Crimson Dawn v0.2 Q4 K M
Crimson · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
Qwen2 1.5B
Qwen · itlwas
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
TI
TinyDolphin 2.8.1 1.1b Q4 K M
Tinydolphin · itlwas
Params1.1B
Context4K
Q4_K_M0.7 GB
CodingTool use
GE
Gemma 2 27b It
Gemma · itlwas
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
AT
Athena 1 3B Q4 K M
Athena · itlwas
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
QW
Qwen2.5 32B
Qwen · itlwas
Params32.8B
Context128K
Q4_K_M19.9 GB
Roleplay
PH
Phi 3 Mini 4k Instruct
Phi · itlwas
Params3.82B
Context4K
Q4_K_M2.4 GB
Coding
YI
Yi 1.5 9B Chat
Yi · itlwas
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
TI
Tiny Random Orion
Tiny · itlwas
Params22M
Context256
Q4_K_M0.0 GB
GGUF

Keep browsing