IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
QW
Qwen3.5 9B RpRMax v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
HU
Huihui HY MT1.5 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
HU
HuatuoGPT 3 8B
Huatuogpt · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
MI
Minecraftism 4B Uncensored
Minecraftism · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
QW
Qwen3 8B 64k Josiefied Uncensored NEO Max
Qwen · DavidAU
Params8.19B
Context64K
Q4_K_M5.8 GB
QW
VulnLLM-R-7B
Qwen · Mungert
Params7.6B
Context32K
Q4_K_M4.9 GB
AQ
Aquif Grounding 7B
Aquif · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
CO
codegemma-2b
Codegemma · bartowski
Params2.51B
Context8K
Q4_K_M1.6 GB
QW
Qwen2.5 7B Instruct 1M Thinking Claude Gemini GPT5.2 DISTILL PaperWitch Heresy
Qwen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
KR
KrakenSakura Maelstrom 12B v1
Krakensakura · Naphula
Params12.2B
Context128K
Q4_K_M7.5 GB
QW
Qwen3 VL 12B Thinking Brainstorm20x
Qwen · mradermacher
Params11.9B
Context256K
Q4_K_M7.2 GB
SA
Sarashina2.2 1b Instruct v0.1
Sarashina · mmnga
Params1.41B
Context8K
Q4_K_M0.9 GB
AR
ARK 270M Base i1
Ark · usermma
Params252M
Context2K
Q4_K_M0.2 GB
GE
Gemma-4-26B-A4B-It-Ultra-Uncensored-Heretic
Gemma · JMingo
Params25.2B
Context256K
Q4_K_M16.9 GB
IN
InternVL3_5 1B
Internvl · bartowski
Params752M
Context40K
Q4_K_M0.5 GB
CY
Cydonia R1 24B v4.1
Cydonia · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
EX
EXAONE 3.5 32B Instruct
Exaone · bartowski
Params32B
Context32K
Q4_K_M19.3 GB
ME
Menage 12B
Menage · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
LF
LFM2 8B A1B
Lfm · bartowski
Params8.34B
Context125K
Q4_K_M5.1 GB
ST
Strawberrylemonade 70B v1.1
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
AP
Apriel 1.5 15b Thinker
Apriel · bartowski
Params14.4B
Context256K
Q4_K_M8.8 GB
QW
UD 2.0 Qwen3.6 35B A3B Claude 4.6 Opus Reasoning Distilled
Qwen · mfielding92
Params34.7B
Context256K
Q4_K_M22.1 GB
AF
AFM 4.5B
Afm · bartowski
Params4.62B
Context64K
Q4_K_M2.9 GB
PE
Peach 2.0 9B 8k Roleplay Heretic
Peach · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
AN
Anubis 70B v1
Anubis · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
dolphin 2.8 mistral 7b v02
Mistral · bartowski
Params7.24B
Context32K
Q4_K_M4.4 GB
DE
OREAL DeepSeek R1 Distill Qwen 7B
DeepSeek · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
MI
flammenai flammen20 mistral 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
LI
Ling Mini 2.0
Ling · bartowski
Params16.3B
Context32K
Q4_K_M9.9 GB
NE
Nemotron Cascade 8B
Nemotron · bartowski
Params8.19B
Context32K
Q4_K_M5.0 GB