https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-569 DRP 2-D Pipeline <p>As seen in <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-551" title="Create PSF solutions - focused step" class="issue-link" data-issue-key="PIPE2D-551"><del>PIPE2D-551</del></a>, certain high signal-to-noise Neon data produces abysmal solutions. Investigate and identify the problem.  </p> PIPE2D-569

Certain PSF spots failed in the last analysis run

Task Normal Done Done ncaplar ncaplar Tue, 28 Apr 2020 15:07:39 +0000 Mon, 4 May 2020 13:37:46 +0000 Mon, 4 May 2020 13:37:46 +0000 0 1 <p>The origin seems to happen, at least for some of these spots because:</p> <p> </p> <ol> <li>The analysis fails because only spots from one side of defocus are analyzed. In that case, we are essentially doing the extrapolation from defocused to focused measurement and that can fail spectacularly. </li> </ol> <p>I am showing an example of a bad example (Nez5_bad_spot.png) and a nearby good spot (Nez5_nearby_good_spot.png) that illustrates this. </p> <p>I have added in my analysis module (internal version 0.24a) a requirement that for the analysis to be successful, there need to be 2 large images from each side of defocus (where the large image is defined as the image taken when the movement of the slit is larger than 1.5 mm )</p> <p>Additionally, some spots have relatively bad solutions even though there are images available at both sides of the focus. All of these defocused images have areas that are saturated. It turns out that during the reduction of the data, when one uses the option <tt>isr.doSaturationInterpolation=False</tt> the code does not ``grow'' the mask covering the saturated areas, i.e., it flags the pixels just next to saturated pixels as ok. A large number of such pixels with wrong values that are deemed to be acceptable for my analysis leads to wrong solutions. This has been discussed in #drp-2d channel and I am posting the most relevant part of the conversation as an image here.</p> <p>Short terms solution is to remove such images from my analysis. Medium-term solution would be to reanalyze and manually grow the mask. Long term solution is for the ISR pipeline to capture this problem. </p> Relates PIPE2D-551 Development Rank 0|zzs1eo: Story Points 2.0