GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
CO
Yi Coder 1.5B Chat
Coder · itlwas
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
PH
Phi 4 Mini Instruct
Phi · itlwas
Params3.84B
Context128K
Q4_K_M2.5 GB
CodingTool use
GI
Gistral 16B Q4 K M
Gistral · itlwas
Params16.8B
Context32K
Q4_K_M10.1 GB
CodingTool use
GR
Granite 3.1 1b A400M Base
Granite · itlwas
Params1.33B
Context128K
Q4_K_M0.8 GB
GGUF
LL
Dolphin 2.9 Llama3 8b 256k
Llama · itlwas
Params8.03B
Context512K
Q4_K_M4.9 GB
GGUF
SM
SmallThinker 3B Preview
Smallthinker · itlwas
Params3.4B
Context32K
Q4_K_M2.1 GB
Reasoning
OR
Orca 2 13b
Orca · itlwas
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
GR
Granite 3.0 1b A400M Instruct
Granite · itlwas
Params1.33B
Context4K
Q4_K_M0.8 GB
Tool use
YI
Nous Hermes 2 Yi 34B Q4 K M
Yi · itlwas
Params34.4B
Context4K
Q4_K_M20.7 GB
Tool use
QW
Qwen3 1.7B Base
Qwen · itlwas
Params1.72B
Context32K
Q4_K_M1.1 GB
ReasoningTool use
NO
Nous Hermes 2 SOLAR 10.7B Q4 K M
Nous · itlwas
Params10.7B
Context4K
Q4_K_M6.5 GB
Tool use
LL
Llama 3.2 3B Instruct
Llama · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
LL
Llama 3 8B Web Q4 K M
Llama · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
CU
Custom KoLLM 13B v1 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
AV
Ava 1.5 12B Q4 K M
Ava · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
PH
Dolphin 2.9.2 Phi 3 Medium
Phi · itlwas
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
SM
SmolLM2 135M
SmolLM · itlwas
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
OP
openchat v3.2 Q4 K M
Openchat · itlwas
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
SE
SeaLLMs v3 1.5B Chat
Seallms · itlwas
Params1.54B
Context128K
Q4_K_M1.0 GB
GGUF
PH
dolphin 2.9.2 Phi 3 Medium Q4 K M
Phi · itlwas
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
QW
Qwen2.5 32B
Qwen · itlwas
Params32.8B
Context128K
Q4_K_M19.9 GB
Tool use
CH
ChatWaifu_v1.3.1
Chatwaifu · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
TI
TinyLlama_v1.1_chinese
Tinyllama · itlwas
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
AU
Aura 8B
Aura · itlwas
Params8.03B
Context128K
Q4_K_M4.9 GB
RoleplayTool use
SM
SmolLM2 360M Instruct
SmolLM · itlwas
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
CH
ChatWaifu_12B_v2.0
Chatwaifu · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
ReasoningRoleplay
PH
Phi 3.5 Mini Instruct
Phi · itlwas
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
SA
Sailor2 1B
Sailor · itlwas
Params988M
Context32K
Q4_K_M0.7 GB
Tool use
SI
Silicon-Masha-7B
Silicon · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
MI
Mistral 7B Instruct v0.3
Mistral · itlwas
Params7.25B
Context32K
Q4_K_M4.4 GB
Tool use

Keep browsing