GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
YU
YuLan Chat 2 13b
Yulan · itlwas
Params13.2B
Context8K
Q4_K_M8.0 GB
GGUF
SM
SmolLM 360M
SmolLM · itlwas
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
EI
Einstein v2 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 14B
Qwen · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
QW
QwQ 32B Preview
Qwen · itlwas
Params32.8B
Context32K
Q4_K_M19.9 GB
ReasoningTool use
OM
OmniLing V1 8b experimental Q4 K M
Omniling · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
DE
Deepseek Llm 7b Chat
DeepSeek · itlwas
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · itlwas
Params14B
Context128K
Q4_K_M8.6 GB
Coding
RE
Redmond Hermes Coder
Redmond · itlwas
Params15.8B
Context8K
Q4_K_M10.1 GB
CodingTool use
NE
Nemotron 4 Mini Hindi 4b Instruct
Nemotron · itlwas
Params4.19B
Context4K
Q4_K_M2.7 GB
Tool use
AY
Aya Expanse 32b Abliterated
Aya · itlwas
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
HU
HuatuoGPT O1 8B
Huatuogpt · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
GR
Granite 3.1 8b Instruct
Granite · itlwas
Params8.17B
Context128K
Q4_K_M4.9 GB
Tool use
ME
Meno Tiny 0.1
Meno · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
QW
Qwen1.5 14B
Qwen · itlwas
Params14.2B
Context32K
Q4_K_M9.2 GB
GGUF
OL
OLMo 2 1124 7B Instruct Q4 K M
OLMo · itlwas
Params7.3B
Context4K
Q4_K_M4.5 GB
GGUF
QW
Qwen2 7B
Qwen · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
AR
Arch Function 3B Q4 K M
Arch · itlwas
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
SA
Salt Asr_Wav Uni_1_Tts_Wav Uni_1 12k
Salt · itlwas
Params3.23B
Context128K
Q4_K_M2.0 GB
GGUF
CH
ChatWaifu_v2.0_22B
Chatwaifu · itlwas
Params22.2B
Context32K
Q4_K_M13.3 GB
ReasoningRoleplay
BI
BioMistral 7B SLERP Q4 K M
Biomistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
QwQ 0.5B Distilled Q4 K M
Qwen · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
Reasoning
AY
Aya Expanse 8b
Aya · itlwas
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
EI
Einstein v4 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
QW
Qwen2.5 14B
Qwen · itlwas
Params14.8B
Context128K
Q4_K_M9.0 GB
Roleplay
RU
HomerCreativeAnvita Mix Qw7B
Ruadapt · itlwas
Params7.58B
Context32K
Q4_K_M4.7 GB
Tool use
DA
DarkAtom 12B v3 Q4 K M
Darkatom · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
PH
Phi 3 Mini 128k Instruct
Phi · itlwas
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
AW
AwA 0.5B Q4 K M
Awa · itlwas
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
AR
Arch Function 1.5B Q4 K M
Arch · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use

Keep browsing