https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-986 DRP 2-D Pipeline <p><tt>CALIB-PFI-20211220</tt> does not contain any <tt>m</tt> band calibs. Investigate and add those to the latest CALIB.</p> PIPE2D-986

Add m-band detectorMap and fiberProfile to latest CALIB

Task Normal Done Done hassan hassan calib-mgmt Tue, 22 Feb 2022 14:20:42 +0000 Fri, 12 Aug 2022 16:41:06 +0000 Fri, 12 Aug 2022 16:41:06 +0000 0 1 <p>Created a copy of <tt>CALIB-20220615</tt> (built for <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1045" title="Regenerate CALIB detectormaps using doSlitOffset=True" class="issue-link" data-issue-key="PIPE2D-1045"><del>PIPE2D-1045</del></a>) to new calib folder <tt>CALIB-20220615</tt> and added <tt>m</tt>-band detectorMap and fiberProfiles with <tt>doSlitOffset=True</tt>. Compared residuals by running <tt>reduceArc</tt> for visit 63351 using this newly generated calib folder: <span class="image-wrap" style=""><a id="15218_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/15218/15218_specImage-v63351-m1-SuNSS-2021-06-16.png" title="specImage-v63351-m1-SuNSS-2021-06-16.png" file-preview-type="image" file-preview-id="15218" file-preview-title="specImage-v63351-m1-SuNSS-2021-06-16.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/15217/_thumb_15217.png" style="border: 0px solid black" /></a></span> , and the next most recent calib folder containing <tt>m</tt>-band calibs, <tt>CALIB-SuNSS-2021-06-16</tt>: <span class="image-wrap" style=""><a id="15218_thumb" href="https://pfspipe.ipmu.jp/jira/secure/attachment/15218/15218_specImage-v63351-m1-SuNSS-2021-06-16.png" title="specImage-v63351-m1-SuNSS-2021-06-16.png" file-preview-type="image" file-preview-id="15218" file-preview-title="specImage-v63351-m1-SuNSS-2021-06-16.png"><img src="https://pfspipe.ipmu.jp/jira/secure/thumbnail/15218/_thumb_15218.png" style="border: 0px solid black" /></a></span> . Vertical striping is clearly diminished in the new calib set.</p> <p>m-band detector map has been generated by bootstrapping from simulator detectormap using 21-fiber <tt>Ne</tt> arc and then running <tt>reduceArc</tt> on SuNSS visit 63350. Key stats below:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> reduceArc.fitDetectorMap INFO: Final fit: chi2=56831.010268 dof=23890 xRMS=0.049894 yRMS=0.069913 (0.003298 nm) xSoften=0.028745 ySoften=0.042386 from 12017/13225 lines reduceArc.fitDetectorMap INFO: Final result: chi2=30246.331401 dof=23388 xRMS=0.021701 yRMS=0.060891 xSoften=0.000000 ySoften=0.033281 from 12017 lines </pre> </div></div> <p>New calib folder <tt>CALIB-20220622</tt> available on the Princeton tiger cluster under <tt>/projects/HSC/PFS/Subaru</tt>, at the summit (<tt>/data/drp/sm1-5.2/</tt>) and Hilo (<tt>/work</tt>).</p> <p>As Arnaud and Yabe-san have discovered, the <tt>CALIB-20220622</tt> calib is problematic and has been removed. Running <tt>reduceExposure</tt> against this calib resulted in strange <tt>pfsArm</tt> spectra as shown in <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/15304/15304_v78699-20220622.png" title="v78699-20220622.png attached to PIPE2D-986">v78699-20220622.png^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span> and <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/15301/15301_v78705-20220622.png" title="v78705-20220622.png attached to PIPE2D-986">v78705-20220622.png^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span>. Compare this with the result of processing with the previous official calib, <tt>CALIB-PFI-20211220</tt> (<span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/15305/15305_v78699-20211220.png" title="v78699-20211220.png attached to PIPE2D-986">v78699-20211220.png^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span>, <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/15302/15302_v78705-20211220.png" title="v78705-20211220.png attached to PIPE2D-986">v78705-20211220.png^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span>).</p> <p>This is due to an incorrect profile radius set when constructing the fiber profiles. Using <tt>profiles.profileRadius=3 repair.doCosmicRay=False</tt> when running <tt>constructFiberProfiles</tt> leads to the expected spectra shown in <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/15303/15303_v78699-20220630.png" title="v78699-20220630.png attached to PIPE2D-986">v78699-20220630.png^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span> and <span class="nobr"><a href="https://pfspipe.ipmu.jp/jira/secure/attachment/15300/15300_v78705-20220630.png" title="v78705-20220630.png attached to PIPE2D-986">v78705-20220630.png^{<img class="rendericon" src="https://pfspipe.ipmu.jp/jira/images/icons/link_attachment_7.gif" height="7" width="7" align="absmiddle" alt="" border="0"/>}</a></span>.</p> <p>The updated calib, <tt>CALIB-20220630</tt> is already available on the Princeton cluster. This will also be copied over to to the summit and Hilo.</p> <p>Calib <tt>CALIB-20220630</tt> also copied to the summit and Hilo.</p> Relates PIPE2D-1045 Development Rank 0|02qpjd:041k Sprint 2DDRP-2022 B 2DDRP-2022 C 2DDRP-2022 D 2DDRP-2022 E Story Points 1.0