GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mistral-7B-Instruct-v0.2
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AH
Ahma 3B Instruct
Ahma · itlwas
Params3.63B
Context2K
Q4_K_M2.8 GB
GGUF
QW
Qwen1.5 1.8B
Qwen · itlwas
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
PH
phi 1 Q4 K M
Phi · itlwas
Params1.42B
Context2K
Q4_K_M0.9 GB
Coding
GR
Granite 3.1 2b Instruct
Granite · itlwas
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool use
EX
EXAONE 3.0 7.8B Instruct
Exaone · itlwas
Params7.82B
Context4K
Q4_K_M4.8 GB
GGUF
CO
Codepy Deepthink 3B Q4 K M
Codepy · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingReasoningTool use
QW
Qwen2.5 32B Instruct
Qwen · itlwas
Params32.8B
Context32K
Q4_K_M19.9 GB
Tool use
MI
Dolphin 2.6 Mistral 7b
Mistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
QW
Qwen3 1.7B
Qwen · itlwas
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen2.5 Math 1.5B Instruct
Qwen · itlwas
Params1.54B
Context4K
Q4_K_M1.0 GB
Tool use
QW
Qwen2.5 1.5B
Qwen · itlwas
Params1.54B
Context128K
Q4_K_M1.0 GB
Tool use
VI
Vikhr 7b 0.1
Vikhr · itlwas
Params7.31B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Llama Guard 3 1B
Llama · itlwas
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
LL
llama 3 8b gpt 4o Q4 K M
Llama · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.2 Taiwan 3B Q4 K M
Llama · itlwas
Params3.61B
Context128K
Q4_K_M2.2 GB
Reasoning
VI
Violet Twilight v0.2 Q4 K M
Violet · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
OP
openchat 3.5 0106 Q4 K M
Openchat · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
SA
SAINEMO reMIX Q4 K M
Sainemo · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
Qwen3 14B Base
Qwen · itlwas
Params14.8B
Context32K
Q4_K_M9.0 GB
ReasoningTool use
LL
Dolphin 2.9 Llama3 8b 1m
Llama · itlwas
Params8.03B
Context1024K
Q4_K_M4.9 GB
CodingTool use
QW
Qwen2 1.5B Instruct
Qwen · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LL
Llama 3.1 8B Lexi Uncensored Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 3.1 Tulu 3 8B Q4 K M
Llama · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LL
Llama 600M Rus
Llama · itlwas
Params548M
Context2K
Q4_K_M0.4 GB
GGUF
AC
AceGPT v2 8B Chat
Acegpt · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
LL
Nous Hermes Llama 2 7b
Llama · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
Tool use
TR
Triangulum 5B
Triangulum · itlwas
Params5.41B
Context8K
Q4_K_M3.4 GB
Reasoning
AP
Apollo 6B
Apollo · itlwas
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF

Keep browsing