IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
XX
T5 V1_1 Xxl
Xxl · chatpig
Params4.76B
Context512
Q4_K_M2.9 GB
HA
Harmonic Hermes 9B
Harmonic · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
FA
Falcon3 3B Base
Falcon · bartowski
Params3.23B
Context32K
Q4_K_M2.0 GB
OP
OpenThinker Agent v1
Openthinker · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ZE
Zeta 2.1
Zeta · mradermacher
Params8.25B
Context32K
Q4_K_M5.1 GB
QW
shisa v2.1 qwen3 8b UD japanese imatrix
Qwen · dahara1
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
QwQ 32B
Qwen · duyntnet
Params32.8B
Context40K
Q4_K_M19.9 GB
GE
Gemma The Writer 9B HERETIC Uncensored Abliterated
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
LLaMA Mesh
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3-1.7B
Qwen · XythicK
Params1.72B
Context40K
Q4_K_M1.1 GB
PH
Phi 3 medium 4k instruct IMat
Phi · legraphista
Params14B
Context4K
Smallest3.0 GB
LL
Llama Deepsync 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
lightblue suzume llama 3 8B multilingual
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
MI
Ministral-3-8B-Nymphaea-RP
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
TO
ToolCUA 8B
Toolcua · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
QW
MathSmith DS Qwen 7B LongCoT
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
IS
Isaak Carter J.O.S.I.E.3 Beta9 7B slerp
Isaak · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
TI
TimeLens 7B
Timelens · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen2.5 Coder 1.5B Unsensored DPO
Qwen · Olak17
Params1.54B
Context32K
Q4_K_M1.0 GB
CA
CabraMistral7b v2
Cabramistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LL
Llama 3.1 Pro Coder v1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 4B Claude Sonnet 4 Reasoning Distill Heretic Abliterated Heretic Abliterated
Qwen · Kirill777Vais
Params4.02B
Context40K
Q4_K_M2.5 GB
DA
L3.1 Dark Reasoning Dark Planet Hermes R1 Uncensored Horror Imatrix MAX 8B
Dark · DavidAU
Params8B
Context128K
Q4_K_M5.5 GB
QW
Qwen3.5-4B
Qwen · cmp-nct
Params4.21B
Context256K
Q4_K_M2.7 GB
MI
allura org Mistral Small 24b Sertraline 0304
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
BA
BananaQwen
Bananaqwen · mradermacher
Params15.5B
Context256K
Q4_K_M9.6 GB
RO
RolmOCR
Rolmocr · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GE
Gemma4 E4B It Abliterated AND Disinhibited USE THIS
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
IN
JanusCoder 14B
InternLM · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
ME
MedicalQwen3 Reasoning 14B IT
Medicalqwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB