https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-359 DRP 2-D Pipeline <p>Princeton are receiving LAM data regularly on the <tt>/tigress</tt> filesystem on their internal cluster. The 2DDRP pipeline should be run against those data frequently.</p> <p>The raw LAM data consists of:</p> <ol> <li>Raw biases</li> <li>Raw darks</li> <li>Raw dithered flats</li> <li>Raw flats</li> <li>Raw arc images</li> </ol> <p>The extent of the pipeline run should be such that all of these data types be reduced, with the resultant products being</p> <ol> <li>Biases</li> <li>Darks</li> <li>Flats</li> <li>FiberTraces</li> <li>Updated detectorMaps.</li> </ol> <p>The pipeline can be ran manually at this stage, with the user providing the necessary visits. Automation will be the subject of a separate ticket when this is needed.</p> PIPE2D-359

Set up regular pipeline runs using real (LAM) data

Task Normal Done Done price hassan Mon, 18 Feb 2019 22:02:51 +0000 Tue, 21 May 2019 14:10:04 +0000 Mon, 1 Apr 2019 01:18:20 +0000 0 6 <p>Based on offline discussion with <a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=hassan" class="user-hover" rel="hassan">hassan</a>, I understand that what is wanted is a script that will run the calib construction part of the pipeline, given a set of biases, darks, flats and arcs identified by the user. This can be adapted from the existing integration test script.</p> <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=hassan" class="user-hover" rel="hassan">hassan</a>, could you please check that this is sufficient?</p> <p>Before I forget, numbers for the data that we currently have:</p> <h3><a name="Neondatanumbers%3A"></a>Neon data numbers:</h3> <p>bias: 12122..12136<br/> dark: 12137..12166<br/> flat: 12167..12171<br/> ditheredFlats: 12172..12300</p> <p>focused data:<br/> 12355..12360<br/> 12415...12477</p> <p>defocused data:<br/> 12301..12354<br/> 12361..12414</p> <p>HgAr data numbers:<br/> bias: 11485..11499<br/> dark: 11500..11529<br/> flat: 11530..11534<br/> ditheredFlats: 11535..11663</p> <p>focused data:<br/> 11664..11693<br/> 11748..11753<br/> 11808..11834</p> <p>defocused data:<br/> 11694..11747<br/> 11754..11807</p> <p>Krypton data numbers</p> <p>bias: 13128..13152 (but have no DATE-OBS) - DO NOT USE - see <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-424" title="Investigate very wide traces " class="issue-link" data-issue-key="PIPE2D-424"><del>PIPE2D-424</del></a><br/> dark: 13153..13182 (but have no DATE-OBS) - DO NOT USE - see <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-424" title="Investigate very wide traces " class="issue-link" data-issue-key="PIPE2D-424"><del>PIPE2D-424</del></a><br/> flat: 13183..13187 - DO NOT USE - see <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-424" title="Investigate very wide traces " class="issue-link" data-issue-key="PIPE2D-424"><del>PIPE2D-424</del></a><br/> ditheredFlats: 13188..13316 - DO NOT USE - see <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-424" title="Investigate very wide traces " class="issue-link" data-issue-key="PIPE2D-424"><del>PIPE2D-424</del></a></p> <p>focused data:<br/> 12922..12996<br/> 13051..13056<br/> 13111..113137</p> <p>defocused data:<br/> 12997..13050<br/> 13057..13110</p> <p>Initial implementation viewed as done. Further work may be required as we more understanding of LAM needs etc.</p> <p>Merged to master.</p> Development Rank 0|02qpt6:508yjj4 Reviewers hassan Sprint 2DDRP-2019 C Story Points 4.0