GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
OP
openchat 3.5 Q4 K M
Openchat · itlwas
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
CU
CursedMatrix 8B v9 Q4 K M
Cursedmatrix · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
MI
Mistral Nemo Base 2407
Mistral · itlwas
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
CH
ChatWaifu_v1.4
Chatwaifu · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
RoleplayTool use
KO
Kosmos 8B v1 Q4 K M
Kosmos · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
QW
Qwen2.5 32B
Qwen · itlwas
Params32.8B
Context128K
Q4_K_M19.9 GB
Roleplay
SM
SmolLM 1.7B Instruct Q4 K M
SmolLM · itlwas
Params1.71B
Context2K
Q4_K_M1.1 GB
Tool use
SM
SmolLM 135M
SmolLM · itlwas
Params135M
Context2K
Q4_K_M0.1 GB
Tool use
IN
Internlm2 Math 7b
InternLM · itlwas
Params7.74B
Context8K
Q4_K_M4.7 GB
GGUF
GH
Ghost 8b Beta 1608
Ghost · itlwas
Params8.03B
Context8K
Q4_K_M4.9 GB
Tool use
CH
ChatYuan 7B
Chatyuan · itlwas
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
IN
Internlm2_5 20b
InternLM · itlwas
Params19.9B
Context256K
Q4_K_M12.0 GB
GGUF
BI
BioMistral 7B DARE Q4 K M
Biomistral · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GW
GWQ2b Q4 K M
Gwq · itlwas
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
AC
AceGPT v2 32B
Acegpt · itlwas
Params32.5B
Context32K
Q4_K_M19.7 GB
GGUF
AW
AwA 1.5B Q4 K M
Awa · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
EX
EXAONE Deep 7.8B
Exaone · itlwas
Params7.82B
Context32K
Q4_K_M4.8 GB
GGUF
GR
Granite 3.0 1b A400M Base
Granite · itlwas
Params1.38B
Context4K
Q4_K_M0.9 GB
GGUF
OL
OLMo 2 1124 13B
OLMo · itlwas
Params13.7B
Context4K
Q4_K_M8.4 GB
GGUF
YI
EVA Yi 1.5 9B 32K V1 Q4 K M
Yi · itlwas
Params8.83B
Context32K
Q4_K_M5.3 GB
GGUF
AP
Apollo 0.5B
Apollo · itlwas
Params464M
Context32K
Q4_K_M0.3 GB
GGUF
GE
saiga gemma2 9b Q4 K M
Gemma · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CU
Custom KoLLM 13B v5 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
YI
Yi 1.5 9B
Yi · itlwas
Params8.83B
Context12K
Q4_K_M5.3 GB
CodingTool use
QW
Qwen2 Math 1.5B
Qwen · itlwas
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
SA
Sailor 4B
Sailor · itlwas
Params3.95B
Context32K
Q4_K_M2.5 GB
GGUF
MI
Mistral Small Instruct 2409
Mistral · itlwas
Params22.2B
Context32K
Q4_K_M13.3 GB
Tool use
FA
Falcon3 1B Base
Falcon · itlwas
Params1.67B
Context4K
Q4_K_M1.1 GB
GGUF
EX
EXAONE Deep 2.4B
Exaone · itlwas
Params2.41B
Context32K
Q4_K_M1.5 GB
GGUF
OP
openchat v3.2 super Q4 K M
Openchat · itlwas
Params13B
Context4K
Q4_K_M7.9 GB
GGUF

Keep browsing