https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-431 DRP 2-D Pipeline <p>As an offline task, so prior to any pipeline processing, we need to be able from an ideal detector map, create an initial bootstrap detectormap that already takes into consideration 'large' changes such as slit shifts and rotations. </p> <p>The intention of this bootstrap detector map is to ensure that all fibers for a given <tt>PsfDesign</tt> are correctly detected. This leaves finer tuning (CCD shifts for example) to <tt>reduceArc</tt>.</p> <p>The new task should take Neon exposures (as Neon provides a small set of spots) and flats to determine the wavelength solution for a set of fibers and the fiber positions on the CCD and consequently the affine (or equivalent) transformation necessary to correct the ideal detectormap.</p> PIPE2D-431

Implement 'bootstrap' DetectorMap task

Story Normal Done Done price hassan Wed, 29 May 2019 20:13:42 +0000 Mon, 8 Jul 2019 16:03:11 +0000 Tue, 2 Jul 2019 18:59:29 +0000 0 2 <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> pfs@bcaddb6c5cf1:~/pfs/pipe2d-431 $ bootstrapDetectorMap.py DATA --calib CALIB --rerun test --flatId visit=16607 --arcId visit=16292 root INFO: Loading config overrride file <span class="code-quote">'/home/pfs/pfs/obs_pfs/config/bootstrap.py'</span> CameraMapper INFO: Loading exposure registry from /home/pfs/pfs/pipe2d-431/DATA/registry.sqlite3 CameraMapper INFO: Loading calib registry from /home/pfs/pfs/pipe2d-431/CALIB/calibRegistry.sqlite3 CameraMapper INFO: Loading calib registry from /home/pfs/pfs/pipe2d-431/CALIB/calibRegistry.sqlite3 root INFO: Running: /home/pfs/pfs/drp_stella/bin/bootstrapDetectorMap.py DATA --calib CALIB --rerun test --flatId visit=16607 --arcId visit=16292 bootstrap.isr INFO: Performing ISR on sensor {<span class="code-quote">'visit'</span>: 16607, <span class="code-quote">'dateObs'</span>: <span class="code-quote">'2019-04-26'</span>, <span class="code-quote">'site'</span>: <span class="code-quote">'L'</span>, <span class="code-quote">'category'</span>: <span class="code-quote">'A'</span>, <span class="code-quote">'expId'</span>: 16607, <span class="code-quote">'arm'</span>: <span class="code-quote">'r'</span>, <span class="code-quote">'spectrograph'</span>: 1, <span class="code-quote">'field'</span>: <span class="code-quote">'FLAT'</span>, <span class="code-quote">'ccd'</span>: 1, <span class="code-quote">'filter'</span>: <span class="code-quote">'r'</span>, <span class="code-quote">'expTime'</span>: 15.0, <span class="code-quote">'dataType'</span>: <span class="code-quote">'flat'</span>, <span class="code-quote">'taiObs'</span>: <span class="code-quote">'2019-04-26'</span>, <span class="code-quote">'pfiDesignId'</span>: 1099528409104, <span class="code-quote">'slitOffset'</span>: 0.0} bootstrap INFO: Found 10 fibers on flat bootstrap.isr INFO: Performing ISR on sensor {<span class="code-quote">'visit'</span>: 16292, <span class="code-quote">'dateObs'</span>: <span class="code-quote">'2019-04-17'</span>, <span class="code-quote">'site'</span>: <span class="code-quote">'L'</span>, <span class="code-quote">'category'</span>: <span class="code-quote">'A'</span>, <span class="code-quote">'expId'</span>: 16292, <span class="code-quote">'arm'</span>: <span class="code-quote">'r'</span>, <span class="code-quote">'spectrograph'</span>: 1, <span class="code-quote">'field'</span>: <span class="code-quote">'ARC'</span>, <span class="code-quote">'ccd'</span>: 1, <span class="code-quote">'filter'</span>: <span class="code-quote">'r'</span>, <span class="code-quote">'expTime'</span>: 14.999, <span class="code-quote">'dataType'</span>: <span class="code-quote">'arc'</span>, <span class="code-quote">'taiObs'</span>: <span class="code-quote">'2019-04-17'</span>, <span class="code-quote">'pfiDesignId'</span>: 1099528409104, <span class="code-quote">'slitOffset'</span>: 0.0} bootstrap INFO: Found 143 lines in 10 traces bootstrap INFO: Matched 143 lines bootstrap INFO: Median difference from detectorMap: -11.478215,-4.614259 pixels bootstrap INFO: Fit 126/143 points, rms: x=0.197919 y=1.023649 total=0.730920 pixels bootstrap INFO: Updating detectorMap... </pre> </div></div> <p>I've tested this by demonstrating that I get zero shift after updating the detectorMap. The RMS on the shift is about 1 pixel, which should be good enough to find lines. However, the quality of the wavelength solutions, even after using this, remains poor (1-2 pixel RMS).</p> <p>Quality of the wavelength solutions is addressed by <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-436" title="Investigate wavelength solution quality" class="issue-link" data-issue-key="PIPE2D-436"><del>PIPE2D-436</del></a>.</p> <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=hassan" class="user-hover" rel="hassan">hassan</a> approved this on GitHub and Slack.</p> <p>Merged to master.</p> Development Rank 0|02qpt6:508yjmi Reviewers hassan Sprint 2DDRP-2019 E 2DDRP-2019 F Story Points 5.0