IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
CO
Codefu 7b v0.1
Codefu · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
FA
Falcon H1 1.5B Deep Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
TR
Tri 7B Base
Tri · mradermacher
Params7.53B
Context4K
Q4_K_M4.6 GB
GL
GLM 4.6V Flash
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
AN
ANMOLGPT 4B v0.2
Anmolgpt · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
FR
Fara1.5 4B
Frognano · SandLogicTechnologies
Params4.2B
Context256K
Smallest2.2 GB
QW
story_generation_Qwen3_8B_RL
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
MO
MOSS Image
Moss · PALLER-NOVUS
Params5.08B
Context—
Smallest1.2 GB
ME
MediX R1 8B
Medix · MBZUAI
Params8.19B
Context256K
Q4_K_M5.0 GB
MI
MiMo V2.5
Mimo · bartowski
Params310B
Context1024K
Q4_K_M188.8 GB
PA
Papagaio
Papagaio · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
MI
MiniCPM5 2B
MiniCPM · NANI-Nithin
Params2.52B
Context128K
Q4_K_M1.6 GB
GE
Amoral Fallen Omega Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
NE
Acereason-Nemotron-14B
Nemotron · unsloth
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · longsesh
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
Mistral Small 3.1 24B RP
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
hf 100 Llama 3.1 Spellbound StoryWriter 0.1 vllm 16bit
Llama · RichardErkhov
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Mistral Small 24B Instruct 2501
Mistral · BasedAGI
Params23.6B
Context32K
Q4_K_M14.3 GB
GE
Gemma 4 E4B It Mentalchat16K
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GU
Gumini 1B Base i1
Gumini · GuminiResearch
Params1.08B
Context32K
Q4_K_M0.7 GB
ME
MemeLens VLM
Memelens · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
ST
StarfishRP
Starfishrp · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
OM
Omega Evolution 9B v2.0
Omega · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
mergekit community Mistral Small 2501 SCE Mashup 2 24B
Mistral · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Qwen3 14B Ai Expert
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
QwENDEAVR2.5 VL NoCNN i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LF
LFM2 1.2B Extract
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
AC
ActIO-UI-7B-SFT
Actio · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.5 9B Neo
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
QW
Qwen3 VL 8B Instruct Heretic
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB