GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
FI
Fialka 7B v3
Fialka · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
Llama Guard 3 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · itlwas
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
SA
Sailor2 20B
Sailor · itlwas
Params19.2B
Context128K
Q4_K_M11.6 GB
Tool use
TR
Triangulum 10B It
Triangulum · itlwas
Params10.3B
Context32K
Q4_K_M6.3 GB
ReasoningTool use
DE
Deepseek Math 7b Base
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
SM
SmolLM 360M
SmolLM · itlwas
Params362M
Context2K
Q4_K_M0.3 GB
Tool use
YI
Yi 1.5 34B
Yi · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
HU
HuatuoGPT O1 7B
Huatuogpt · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
EU
EuroLLM 9B Instruct
Eurollm · itlwas
Params9.15B
Context4K
Q4_K_M5.6 GB
GGUF
DE
Deepseek Llm 7b Base
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
MI
Mistral Nemo Instruct 2407
Mistral · itlwas
Params12.2B
Context128K
Q4_K_M7.5 GB
Tool use
AT
Athena 1 0.5B Q4 K M
Athena · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen1.5 4B
Qwen · itlwas
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
MI
Ministral 8B Instruct 2410
Mistral · itlwas
Params8.02B
Context32K
Q4_K_M4.9 GB
Tool use
LL
Llama 160m
Llama · itlwas
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
SH
Shieldgemma 9b
Shieldgemma · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen2.5 1.5B
Qwen · itlwas
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
MI
dolphin 2.2 mistral 7b Q4 K M
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
FA
Falcon3 3B Instruct Abliterated
Falcon · itlwas
Params3.23B
Context32K
Q4_K_M2.0 GB
Tool use
SA
Sailor 14B Chat
Sailor · itlwas
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
LL
Llama 7b
Llama · itlwas
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
QW
QwQ LCoT 3B Instruct Q4 K M
Qwen · itlwas
Params3.09B
Context32K
Q4_K_M1.9 GB
ReasoningTool use
LL
Dolphin Llama2 7b
Llama · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
MI
Hermes 2 Pro Mistral 7B Q4 K M
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
YU
YuLan Mini
Yulan · itlwas
Params2.42B
Context28K
Q4_K_M1.8 GB
Coding
LL
Dolphin Llama 13b
Llama · itlwas
Params13B
Context2K
Q4_K_M7.9 GB
GGUF
HI
Hiber Multi 10B Instruct
Hiber · itlwas
Params10.7B
Context4K
Q4_K_M6.5 GB
GGUF
DE
Deepseek Math 7b Rl
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
QW
QWQ 500M Q4 K M
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
ReasoningTool use

Keep browsing