GGUF models by itlwas

475 GGUF models quantized by itlwas on Hugging Face. Sizes run from 5M to 46.7B parameters. The longest trained context is 4192K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
ChatWaifu_v1.2.1
Chatwaifu · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
TR
Trillion 7B Preview
Trillion · itlwas
Params7.53B
Context4K
Q4_K_M4.6 GB
GGUF
MA
Marco o1 Q4 K M
Marco · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
VI
Vikhr tiny 0.1 Q4 K M
Vikhr · itlwas
Params2.78B
Context2K
Q4_K_M1.9 GB
GGUF
GW
GWQ 9B Preview
Gwq · itlwas
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
EI
Einstein v3 7B Q4 K M
Einstein · itlwas
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi 1.5 9B
Yi · itlwas
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
SA
Sailor2 8B Chat
Sailor · itlwas
Params8.55B
Context32K
Q4_K_M5.2 GB
GGUF
NI
NightyGurps 14b v1.1 Q4 K M
Nightygurps · itlwas
Params14.8B
Context32K
Q4_K_M9.0 GB
Tool use
UW
UwU 7B Instruct Q4 K M
Uwu · itlwas
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
SA
Sailor 7B
Sailor · itlwas
Params7.72B
Context32K
Q4_K_M4.8 GB
GGUF
HU
HuatuoGPT2 7B
Huatuogpt · itlwas
Params7.51B
Context4K
Q4_K_M4.6 GB
GGUF
CU
Custom KoLLM 13B v3 Q4 K M
Custom · itlwas
Params13.2B
Context2K
Q4_K_M8.0 GB
GGUF
PO
poemma 12B Q4 K M
Poemma · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
QW
Qwen2 7B Instruct
Qwen · itlwas
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QV
QVikhr 2.5 1.5B Instruct r Q4 K M
Qvikhr · itlwas
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
FA
Falcon3 1B Instruct
Falcon · itlwas
Params1.67B
Context8K
Q4_K_M1.1 GB
Tool use
VI
Vikhr 7B Instruct_0.2
Vikhr · itlwas
Params6.97B
Context2K
Q4_K_M4.2 GB
GGUF
OM
OmniLing V1 12b experimental Q4 K M
Omniling · itlwas
Params12.2B
Context1000K
Q4_K_M7.5 GB
Tool use
QW
Qwen2 Math 7B
Qwen · itlwas
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
TI
TinyLlama_v1.1_math_code
Tinyllama · itlwas
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
EX
EXAONE 3.5 2.4B Instruct
Exaone · itlwas
Params2.41B
Context32K
Q4_K_M1.5 GB
GGUF
SA
Sailor 1.8B
Sailor · itlwas
Params1.84B
Context8K
Q4_K_M1.2 GB
GGUF
LL
YuLan LLaMA 2 13b
Llama · itlwas
Params13.2B
Context8K
Q4_K_M8.0 GB
GGUF
QW
Qwen2 0.5B
Qwen · itlwas
Params494M
Context128K
Q4_K_M0.4 GB
GGUF
LL
Llama 3.2 Kapusta 3B v8
Llama · itlwas
Params3.61B
Context128K
Q4_K_M2.2 GB
Tool use
QW
Qwen2 Math 7B Instruct
Qwen · itlwas
Params7.62B
Context4K
Q4_K_M4.7 GB
GGUF
VI
Vicuna 7b v1.5
Vicuna · itlwas
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
NE
Neo_7B_Instruct_V0.1
Neo · itlwas
Params7.79B
Context8K
Q4_K_M4.7 GB
GGUF
AH
Ahma 7B Instruct
Ahma · itlwas
Params7B
Context2K
Q4_K_M4.3 GB
GGUF

Keep browsing