GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 2b It
Gemma · itlwas
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
YI
Yi 1.5 34B Chat
Yi · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Qwen2 7B
Qwen · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
GE
Gemma 2 9b It
Gemma · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SA
Sailor2 20B Chat
Sailor · itlwas
Params19.2B
Context32K
Q4_K_M11.6 GB
GGUF
QW
Qwen2 0.5B Instruct
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
AZ
Azure Dusk v0.1 Q4 K M
Azure · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
QW
Qwen1.5 4B Chat
Qwen · itlwas
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
LL
Llama Deepsync 1B Q4 K M
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
CodingTool use
IN
Internlm2_5 1_8b
InternLM · itlwas
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
LD
LDAI-1.5-ANIU
Ldai · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
YA
YandexGPT 5 Lite 8B Pretrain
Yandexgpt · itlwas
Params8.04B
Context32K
Q4_K_M4.9 GB
GGUF
IN
Internlm2_5 7b Chat
InternLM · itlwas
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen1.5 32B Chat
Qwen · itlwas
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
MI
Bitnet-Mistral.0.2-47m-v0.1
Mistral · itlwas
Params48M
Context8K
Q4_K_M0.0 GB
GGUF
OL
AMD OLMo 1B SFT
OLMo · itlwas
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Qwen2.5 Math 1.5B
Qwen · itlwas
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
IN
Internlm2_5 1_8b Chat
InternLM · itlwas
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
GW
GWQ 9B Preview2
Gwq · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
OP
Openbuddy Yi1.5 34b v21.3 32k
Openbuddy · itlwas
Params34.4B
Context128K
Q4_K_M20.7 GB
GGUF
VI
Vikhr 7b 0.2
Vikhr · itlwas
Params6.97B
Context2K
Q4_K_M4.2 GB
GGUF
GR
Granite 3.1 1b A400M Instruct
Granite · itlwas
Params1.33B
Context128K
Q4_K_M0.8 GB
Tool use
LL
Llama 3.1 Tulu 3 8B DPO Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AP
Apollo 2B
Apollo · itlwas
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
Qwen1.5 32B
Qwen · itlwas
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
QW
Qwen2.5 7B
Qwen · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
MI
Mistral 7B v0.3
Mistral · itlwas
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Bitnet-Mistral.0.2-47m-v0.2
Mistral · itlwas
Params48M
Context8K
Q4_K_M0.0 GB
GGUF
EI
Einstein v6 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
SM
SmolLM 135M
SmolLM · itlwas
Params135M
Context2K
Q4_K_M0.1 GB
GGUF

Keep browsing