GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
AY
Aya 23 35B
Aya · itlwas
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
QW
Qwen2.5 Math 7B Instruct
Qwen · itlwas
Params7.62B
Context4K
Q4_K_M4.7 GB
Tool use
LL
Meta Llama 3.1 8B Claude Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen3 8B Base
Qwen · itlwas
Params8.19B
Context32K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen2.5 14B
Qwen · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
MI
dolphin 2.2.1 mistral 7b Q4 K M
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek V2 Lite Chat
DeepSeek · itlwas
Params15.7B
Context160K
Q4_K_M10.4 GB
GGUF
MI
MiniCPM3 4B
MiniCPM · itlwas
Params4.07B
Context32K
Q4_K_M2.5 GB
Tool use
LL
Llama 3.1 8B Instruct
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
Stablecode Completion Alpha 3b
Stablecode · itlwas
Params2.77B
Context16K
Q4_K_M1.8 GB
Coding
TI
TinyDolphin 2.8 1.1b Q4 K M
Tinydolphin · itlwas
Params1.1B
Context4K
Q4_K_M0.7 GB
CodingTool use
LL
Llama 3.2 1B Instruct
Llama · itlwas
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
LL
LLaMA O1 Base 1127 Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Mistral 7B Instruct v0.1
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama 3.1 Nemotron Nano 8B v1
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
QW
Qwen3 8B
Qwen · itlwas
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
VI
Vikhr YandexGPT 5 Lite 8B it Q4 K M
Vikhr · itlwas
Params8.04B
Context32K
Q4_K_M4.9 GB
GGUF
HU
HuatuoGPT2 13B
Huatuogpt · itlwas
Params13.9B
Context4K
Q4_K_M9.0 GB
GGUF
LL
Skywork Critic Llama 3.1 8B
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
GE
Gemma 3 1b It
Gemma · itlwas
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
QW
Qwen2.5 7B
Qwen · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
NE
Nemotron Mini 4B Instruct Q4 K M
Nemotron · itlwas
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
ST
Stablecode Completion Alpha 3b 4k
Stablecode · itlwas
Params2.77B
Context4K
Q4_K_M1.8 GB
Coding
LL
Llama 68m
Llama · itlwas
Params68M
Context2K
Q4_K_M0.0 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · itlwas
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
FI
Fialka 7B v2
Fialka · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen1.5 7B Chat
Qwen · itlwas
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
QW
Qwen2 0.5B
Qwen · itlwas
Params494M
Context128K
Q4_K_M0.4 GB
Tool use
LL
Llama 3.2 3B
Llama · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF

Keep browsing