IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
QW
Qwen3 8B Heretic
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
Gemma 3 it 4B Uncensored DBL X
Gemma · DavidAU
Params4.26B
Context128K
Q4_K_M2.7 GB
QW
dolphin-2.9.2-qwen2-7b
Qwen · dphn
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
Gemma 3 270m It
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
ME
Melody1437 12B v0.5
Melody · ReadyArt
Params11.9B
Context256K
Q4_K_M8.6 GB
GE
gemma 4 e2b yemeni arabic assistant
Gemma · yemeni-ai-lab
Params4.63B
Context128K
Q4_K_M3.4 GB
CA
CantoneseLLM v2.0 8B Thinking Chat Vector Merged
Cantonesellm · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
OR
Ornith 1.5 REAP 20B A3B
Ornith · sleepyeldrazi
Params19B
Context256K
Smallest10.5 GB
IN
Index Nailong 9B
Index · mradermacher
Params8.95B
Context224K
Q4_K_M5.6 GB
HY
HybridAgent 14B Agentic
Hybridagent · bartowski
Params14.8B
Context32K
Q4_K_M9.3 GB
VI
Vietnamese 4B Chat abliterated
Vietnamese · N14QM
Params4.2B
Context256K
Q4_K_M2.7 GB
GE
Gemma 4 12B StyleTune
Gemma · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
QW
Huihui Qwen3.5 9B Claude 4.6 Opus Abliterated Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CY
TheDrummer Cydonia 24B v2
Cydonia · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
Llama3-ChatQA-1.5-8B
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
TM
Tmax v1.1 9b
Tmax · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
AL
ALoDLM 8B
Alodlm · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
FI
Fimbulvetr 11B v2 i1
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
GR
Granite 4.2 3b
Granite · bartowski
Params3.66B
Context128K
Q4_K_M2.3 GB
MI
WikiHow Mistral Instruct 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
RI
Ringg Router E2B
Ringg · bartowski
Params4.63B
Context128K
Q4_K_M3.2 GB
KI
Kimi-Dev-72B
Kimi · unsloth
Params72.7B
Context128K
Smallest23.0 GB
LL
Llama-3.1-Nemotron-Nano-8B-V1
Llama · unsloth
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · zugquants
Params8.95B
Context256K
Q4_K_M6.8 GB
ME
Med Advisor Conversation 4B
Med · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
NX
Nxcode-CQ-7B-orpo
Nxcode · legraphista
Params7.25B
Context64K
Smallest2.4 GB
RU
surogate rune 26b a4b
Rune · owao
Params25.2B
Context256K
Q4_K_M16.8 GB
DI
Diffusiongemma 26B A4B It HERETIC Uncensored
Diffusiongemma · yabaimimi
Params25.3B
Context256K
Q4_K_M16.8 GB
MI
MiniCPM V 4.7 1B
MiniCPM · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
MI
Mistral Medium 3.5 128B
Mistral · bartowski
Params125B
Context256K
Q4_K_M78.4 GB