IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
KW
KwaiCoder AutoThink Preview
Kwaicoder · bartowski
Params40.6B
Context32K
Q4_K_M24.6 GB
DR
DreadPoor Harpy 7B Model Stock
Dreadpoor · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5 0.5B Instruct
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
VE
Veloxy SLM 3B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
MiMo Ornith 9B AGSI Abliterated HQ
Mimo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
UC
UCLA AGI zephyr 7b sft full SPIN iter2
Ucla · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
NI
NicholasCorrado zephyr 7b uf rlced conifer dpo 2e
Nicholascorrado · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
UN
Unity Coder 7b
Unity · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MU
Muse 12B
Muse · LatitudeGames
Params12.2B
Context128K
Q4_K_M7.5 GB
GL
GLM4 9B Neon v2
GLM · bartowski
Params9.4B
Context32K
Q4_K_M6.2 GB
MI
Minitron 4B Base
Minitron · legraphista
Params4.19B
Context4K
Smallest1.9 GB
NE
Nemotron 3 Embed 8B BF16
Nemotron · Aqua00
Params7.95B
Context256K
Q4_K_M4.9 GB
JI
Jina Reranker M0
Jina · jinaai
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
BL
Blossom V6.2 8B
Blossom · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GE
L3.3 GeneticLemonade Opus 70B
Geneticlemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
Nous-Hermes-Llama2-13b
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3-Vl-30B-A3B-Thinking-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
LL
cognitivecomputations dolphin 2.9 llama3 8b
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
QW
LLDS A GRPO Qwen2.5 7B Ins i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
SA
Samantha Mythomax l2 13b merge fixed i1
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
AN
ANTRU 3B
Antru · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
PA
Pantheon Rp 1.8 24b Small 3.1
Pantheon · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Llama 3.1 8B Instruct RoleVerse SFT DPO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
TR
Trinity Mini
Trinity · arcee-ai
Params26B
Context128K
Q4_K_M15.9 GB
MI
Minimax H3 pruned
Minimax · PurpleBlazey
Params20.1B
Context256K
Smallest6.3 GB
GE
Gemma Kimu 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
BA
T5 Base
Base · chatpig
Params223M
Context512
Q4_K_M0.1 GB
QW
Qwen3-16B-A3B
Qwen · unsloth
Params16B
Context40K
Q4_K_M9.8 GB