GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
YU
YuLan Chat 3 12b
Yulan · itlwas
Params11.9B
Context4K
Q4_K_M7.2 GB
GGUF
QW
Qwen1.5 0.5B
Qwen · itlwas
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
SA
Sailor 4B Chat
Sailor · itlwas
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
LL
bgGPT llama 3.1 8B Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
SH
Shieldgemma 27b
Shieldgemma · itlwas
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
LL
Llama 3.1 Tulu 3 8B SFT
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
CodingTool use
SA
Sailor 1.8B Chat
Sailor · itlwas
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
Llama 3.1 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LI
T lite 0.1 Q4 K M
Lite · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
UW
UwU 14B Math v0.2 Q4 K M
Uwu · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
GE
Gemma 3 R1984 12B
Gemma · itlwas
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
LL
Llama 3.1 Nemotron 8B UltraLong 1M Instruct Q4 K M
Llama · itlwas
Params8.04B
Context1048K
Q4_K_M4.9 GB
Tool use
QW
Qwen2.5 0.5B
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
CU
Custom KoLLM 13B v4 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
QW
Qwen2.5 Math 7B
Qwen · itlwas
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
BI
BioMistral 7B TIES Q4 K M
Biomistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
CO
Yi Coder 9B
Coder · itlwas
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
YI
Yi 1.5 6B
Yi · itlwas
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
SA
Sailor-0.5B-Chat
Sailor · itlwas
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
DE
DeepSeek V2 Lite
DeepSeek · itlwas
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
RE
Reasoning 0.5b Q4 K M
Reasoning · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
Reasoning
QW
QwQ 0.5B Distilled SFT
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
ReasoningTool use
LU
Lusca 33B Q4 K M
Lusca · itlwas
Params33.2B
Context128K
Q4_K_M19.9 GB
GGUF
GR
Granite 3.1 3b A800M Instruct
Granite · itlwas
Params3.3B
Context128K
Q4_K_M2.0 GB
Tool use
TR
Triangulum 5B It
Triangulum · itlwas
Params5.41B
Context8K
Q4_K_M3.4 GB
Reasoning
CU
Custom KoLLM 13B v7 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
PH
phi 1 5 Q4 K M
Phi · itlwas
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
OL
AMD OLMo 1B SFT DPO
OLMo · itlwas
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
OR
Orca 2 7b
Orca · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF

Keep browsing