IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
EL
ELYZA Thinking 1.0 llm jp 4 32b a3b
Elyza · mmnga-o
Params32.1B
Context64K
Q4_K_M21.4 GB
AY
Aya Expanse 32b Ungated
Aya · RichardErkhov
Params32.3B
Context8K
Q4_K_M19.8 GB
LE
LemonadeRP 4.5.3
Lemonaderp · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
ZU
Zurich 7B GCv2 500k
Zurich · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma-3-4B-It
Gemma · zw89
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 R1 4B v1
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
FA
Falcon3 7B Instruct Heretic
Falcon · mradermacher
Params7.46B
Context32K
Q4_K_M4.6 GB
QW
Qwen2 VL 72B Instruct
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
bu-30b-a3b-preview
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
MI
starmpcc Asclepius Mistral 7B v0.3
Mistral · RichardErkhov
Params7.25B
Context32K
Q4_K_M4.4 GB
AR
arcee ai Arcee Maestro 7B Preview
Arcee · bartowski
Params7.61B
Context128K
Q4_K_M4.7 GB
MU
multi verse model i1
Multi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AM
AmoreLLM 1.7B
Amorellm · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
OL
olmOCR 7B 0225 Preview
OLMo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3 8B Thinking RoleVerse SFT DPO
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CT
Cthulhu 8B v1.4
Cthulhu · mradermacher
Params8B
Context1048K
Q4_K_M4.9 GB
TI
TinyR1 32B Preview v0.2
Tinyr · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
FL
Flammen Kunoichi 7B
Flammen · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
DA
PocketDoc Dans SakuraKaze V1.0.0 12b
Dans · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
TO
Tongyi-DeepResearch-30B-A3B
Tongyi · Mungert
Params30.5B
Context128K
Q4_K_M19.0 GB
QW
EgoActor 8b Qwen3VL
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · duyntnet
Params1.54B
Context32K
Q4_K_M1.0 GB
FO
Foundation Sec 1.1 8B Instruct
Foundation · mradermacher
Params8.03B
Context64K
Q4_K_M4.9 GB
GL
Qwopus GLM 18B Healed
GLM · mradermacher
Params15.9B
Context256K
Q4_K_M9.8 GB
LL
codellama CodeLlama 13b Python hf
Llama · RichardErkhov
Params13B
Context—
Q4_K_M0.0 GB
CR
Crystal Think V2
Crystal · bartowski
Params4B
Context32K
Q4_K_M2.5 GB
YI
Nous-Hermes-2-Yi-34B
Yi · duyntnet
Params34.4B
Context4K
Q4_K_M20.7 GB
LI
LightOnOCR-2-1B
Lightonocr · Mungert
Params596M
Context16K
Q4_K_M0.4 GB
QW
Vikhr-Qwen-2.5-1.5B-Instruct
Qwen · Vikhrmodels
Params1.54B
Context32K
Q4_K_M1.0 GB
FA
Falcon3 3B Instruct
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB