https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1250 DRP 2-D Pipeline <p>Run the detectorMap QA for EDR2 and provide text and numbers for the (short) release note.</p> PIPE2D-1250

detectorMap QA for EDR2

Task Normal In Progress Unresolved Wilfred Gee Masayuki Tanaka EDR QualityAssurance Mon, 10 Jul 2023 07:08:25 +0000 Wed, 31 Jan 2024 09:52:42 +0000 0 5 <p>The following plots show the median positional error in pixels (`dx`) for each fiber, meaning each point in the plot represents the median value for a given fiber for a given visit. </p> <p>The plots are split up so each page shows a single spectrograph for a given run (<tt>run08</tt>, <tt>run11</tt>, <tt>run12</tt>), each row shows the arm, and each column shows the calibration version (<tt>v3</tt>, <tt>v5</tt>, <tt>v6</tt>). The points are color-coded according to their label (e.g. "sky", "calspec", "ga", "ge", etc.).</p> <p>Most of these look fairly "normal" (i.e. median residuals near zero) except for the single attached plot ("Figure 13"), which shows spectrograph=3 and <tt>run12</tt> and shows that we did not really do well for the sky fields during <tt>run12</tt> in any arm, compared with the full pdf which shows we did do alright in the sky for the other runs and spectrograph. </p> <p><span class="image-wrap" style=""><a id="16579_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/16579/16579_Figure+15.png" title="Figure 15.png" file-preview-type="image" file-preview-id="16579" file-preview-title="Figure 15.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/16578/_thumb_16578.png" style="border: 0px solid black" /></a></span> </p> <p>"Figure 15" is a copy of this plot but split up by the "status" (e.g. <tt>DETECTORMAP_USED</tt> and <tt>DETECTORMAP_RESERVED</tt>).</p> <p><span class="image-wrap" style=""><a id="16584_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/16584/16584_Figure+16.png" title="Figure 16.png" file-preview-type="image" file-preview-id="16584" file-preview-title="Figure 16.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/16579/_thumb_16579.png" style="border: 0px solid black" /></a></span> </p> <p> <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/16577/16577_fiber-median-by-spec-dx_median-label.pdf" title="fiber-median-by-spec-dx_median-label.pdf attached to PIPE2D-1250">fiber-median-by-spec-dx_median-label.pdf^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span> </p> <p>What is the unit of dx_median? Pixel?</p> <p>&gt; What is the unit of dx_median? Pixel?</p> <p> </p> <p>Yes, sorry, we agreed to put things always in pixels. I have it listed on the top of the full PDF I think but I'll put it on the axis labels as well, thanks.</p> <p> </p> <p> </p> <p>The dominant feature in Figure 13 above was found to be the two out of focus visits.  The following plot is the same thing but with those visits removed (<tt>97484</tt> and <tt>97485</tt>).</p> <p> <span class="image-wrap" style=""><a id="16585_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/16585/16585_out-of-focus.png" title="out-of-focus.png" file-preview-type="image" file-preview-id="16585" file-preview-title="out-of-focus.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/16584/_thumb_16584.png" style="border: 0px solid black" /></a></span> </p> <p>However we also started to question why the out of focus data would cause the data to behave in a non-symmetrical way (see plot below) and why the <tt>n</tt> band looks like it was processed as two separate halves (it shouldn't be, according to <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=price" class="user-hover" rel="price">price</a>). Currently <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=arnaud.lefur" class="user-hover" rel="arnaud.lefur">arnaud.lefur</a> is looking into this issue.</p> <p> <span class="image-wrap" style=""><a id="16586_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/16586/16586_Figure+17.png" title="Figure 17.png" file-preview-type="image" file-preview-id="16586" file-preview-title="Figure 17.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/16585/_thumb_16585.png" style="border: 0px solid black" /></a></span> </p> <p><tt>Figure 16</tt> shows the data with the out of focus visits removed, which then also reveals a feature in the center of the <tt>n</tt> band. This seems to correspond to the faint mtp bundle so we are not investigating further. The following plots show the same feature present in the spectral (i.e. <tt>dy</tt> in pixels) offsets:</p> <p><span class="image-wrap" style=""><a id="16587_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/16587/16587_Figure+18.png" title="Figure 18.png" file-preview-type="image" file-preview-id="16587" file-preview-title="Figure 18.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/16586/_thumb_16586.png" style="border: 0px solid black" /></a></span></p> <p>Zoom:<br/> <span class="image-wrap" style=""><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/16587/_thumb_16587.png" style="border: 0px solid black" /></span></p> <p>Yes so I was able to look at those visits.<br/> A bit of context first, not only the slit was defocused but also rotated along y-axis (x-axis being focus, z axis vertical)<br/> meaning that one side of the slit was closer to focus and the other side further away.<br/> In the spatial direction it means that the slit has a bigger apparent size. </p> <p> <span class="image-wrap" style=""><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/16589/_thumb_16589.png" style="border: 0px solid black" /></span> </p> <p>You can see that the right part of the curve is close to 0, then at you go left, the spots are more and more defocused, and moving to the left.<br/> At some point the detectorMap is bad enough, that the fiber identification is wrong, spots are then assigned to the neighbouring fiber, which is explained the sudden discontinuity.</p> <p>The DetectorMap QA should have detected that the spot IDs are off, meaning that some spots weren't found. So that's another thing to track.</p> <p>We saw this before when a fibre was mis-identified near the left edge of on of the right-hand CCDs, leading to odd distortions</p> <p>Attached are the median <tt>dx</tt> offsets in pixels for every 20th fiber across all visits in EDR2.</p> <p>Ideally the offsets should all be noise around zero, ideally improving with each run, which doesn't appear to be the case for most of the detectors.</p> <p> </p> <p><span class="image-wrap" style=""><img src="https://pfspipe.ipmu.jp/jira/secure/attachment/16624/16624_fiber-medians.png" style="border: 0px solid black" /></span></p> Blocks PIPE2D-1215 Relates PIPE2D-1315 PIPE2D-1249 Development Rank 0|02qph7:06r0903hi Sprint EDR+AIT Story Points 3.0