https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-472 DRP 2-D Pipeline <p>In the ideal case, in order to determine the traces for high-density fiber data, two quartz exposures need to be prepared, one with the even-numbered fibers illuminated, and the other with the alternate odd-numbered fibers illuminated.</p> <p>However, this has not been possible for recent high-density fiber data from LAM. Please develop a rough strategy of determining the traces from such data in order to reduce those data.</p> PIPE2D-472

Strategy for determining traces from non-odd/even high-density fiber data

Story Normal Done Done price hassan Fri, 1 Nov 2019 20:25:51 +0000 Mon, 4 Jan 2021 20:23:09 +0000 Fri, 26 Jun 2020 18:15:27 +0000 0 2 <p>My plan is to get a rough analytical fit to the spatial profile from low-density fiber data, and use that whenever high-density fiber data restricts the spatial range.</p> <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=hassan" class="user-hover" rel="hassan">hassan</a> recommends looking at "visits 436..441 . Under /projects/HSC/PFS/Subaru/raw/pfs/2019-12-17/ on the Princeton cluster."</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> detrend.py /projects/HSC/PFS/Subaru --calib /projects/HSC/PFS/Subaru/CALIB-price --rerun price/pipe2d-472/fiberTraces --id visit=448 -c isr.doFlat=False measureFiberProfile.py /projects/HSC/PFS/Subaru --calib /projects/HSC/PFS/Subaru/CALIB-price/ --rerun price/pipe2d-472/fiberTraces --id visit=448 arm=r -c buildFiberTraces.profileRadius=7 --log measureFiberProfile.buildFiberTraces=DEBUG constructFiberTrace.py /projects/HSC/PFS/Subaru --calib /projects/HSC/PFS/Subaru/CALIB-price --rerun price/pipe2d-472/fiberTraces --id visit=455 arm=r -C constructFiberTrace-config.py --batch-type=none ingestCalibs.py /projects/HSC/PFS/Subaru --calib /projects/HSC/PFS/Subaru/CALIB-price /projects/HSC/PFS/Subaru/rerun/price/pipe2d-472/fiberTraces/FIBERTRACE/pfsFiberTrace-2019-12-17-000455-r1.fits --validity 1000 reduceExposure.py /projects/HSC/PFS/Subaru --calib /projects/HSC/PFS/Subaru/CALIB-price --rerun price/pipe2d-472/fiberTraces --id visit=453..457 arm=r plotArm.py /projects/HSC/PFS/Subaru --calib /projects/HSC/PFS/Subaru/CALIB-price --rerun price/pipe2d-472/fiberTraces --id visit=453..457 arm=r --filename <span class="code-quote">'spectra-%(visit)d-%(arm)s%(spectrograph)d.png'</span> </pre> </div></div> <p>All the extracted spectra from 455 are unity +/- epsilon (with epsilon ~ 2e-8), as expected.</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> &gt;&gt;&gt; butler = Butler(<span class="code-quote">"/projects/HSC/PFS/Subaru/rerun/price/pipe2d-472/fiberTraces"</span>) &gt;&gt;&gt; ss = butler.get(<span class="code-quote">"pfsArm"</span>, visit=457, arm=<span class="code-quote">"r"</span>) &gt;&gt;&gt; ss.flux[ss.mask == 0].mean() # exposure time is twice that of 455, so expect 2 2.005703 &gt;&gt;&gt; ss.flux[ss.mask == 0].std() 0.08082811 &gt;&gt;&gt; np.percentile(ss.flux[ss.mask == 0], (25.0, 75.0)) array([1.99344251, 2.01826459]) &gt;&gt;&gt; 0.741*(2.01826459-1.99344251) 0.018393161279999893 &gt;&gt;&gt; np.sqrt(ss.variance[ss.mask == 0].mean()) 0.0118158533126398 </pre> </div></div> <p>So noise is not too crazy. Outliers (std <span class="error">Unable to render embedded object: File (= robust std) are likely due to CRs (1200 sec exposure) not found.</span>).</p> <p><tt>constructFiberTrace-config.py</tt> is:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> from pfs.drp.stella.extendFiberProfile <span class="code-keyword">import</span> BuildExtendedFiberTracesTask from pfs.drp.stella.buildFiberTraces <span class="code-keyword">import</span> BuildFiberTracesTask config.trace.retarget(BuildExtendedFiberTracesTask) config.trace.filename = <span class="code-quote">"profile-448-r1.pkl"</span> config.trace.profileRadius = 2 config.trace.centroidRadius = 2 </pre> </div></div> <p>Did some optimisation of the new <tt>BuildFiberTraceTask</tt> so it wouldn't take forever on dense fiber data, and added new code to be able to extract spectra on dense fiber data.</p> <p>Merged to master.</p> Development Rank 0|02qprv:o8 Reviewers hassan Sprint 2DDRP-2019 I 2DDRP-2019 J 2DDRP-2021 A Story Points 4.0