https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-655 DRP 2-D Pipeline <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=fmadec" class="user-hover" rel="fmadec">fmadec</a> wants to reduce <tt>b2</tt> data, but the pipeline doesn't know about it. Add in all the detectors.</p> PIPE2D-655

Support all spectrograph detectors

Story Blocker Done Done price price Fri, 20 Nov 2020 14:41:25 +0000 Wed, 20 Jan 2021 18:27:09 +0000 Tue, 24 Nov 2020 21:54:24 +0000 0 2 <p>Blocks SM2 activities at LAM.</p> <p>Need to:</p> <ul> <li>Add detectors to the <tt>camera.yaml</tt> file.</li> <li>Generate detectorMaps.</li> </ul> <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=hassan" class="user-hover" rel="hassan">hassan</a>, I believe this is ready for review. I tested it out:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> ingestPfsImages.py /projects/HSC/PFS/LAM --mode=link --config clobber=True register.ignore=True parse.pfsDesignId=0x0000010001001010 --pfsConfigDir=/projects/HSC/PFS/LAM/raw/pfsDesign -- <span class="code-quote">"/projects/HSC/PFS/LAM/raw<span class="code-comment">/*/PFLA*"</span> <span class="code-quote">"/projects/HSC/PFS/LAM/raw/*/</span>sps/PFLA*"</span> (lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-655 $ constructPfsBias.py /projects/HSC/PFS/LAM --calib /projects/HSC/PFS/LAM/CALIB-price --rerun price/pipe2d-655 --id visit=23638..23652 --cores 10 RuntimeError: No defects available <span class="code-keyword">for</span> dataId=DataId(initialdata={<span class="code-quote">'visit'</span>: 23644, <span class="code-quote">'dateObs'</span>: <span class="code-quote">'2020-11-20'</span>, <span class="code-quote">'site'</span>: <span class="code-quote">'L'</span>, <span class="code-quote">'category'</span>: <span class="code-quote">'A'</span>, <span class="code-quote">'arm'</span>: <span class="code-quote">'b'</span>, <span class="code-quote">'spectrograph'</span>: 2, <span class="code-quote">'field'</span>: <span class="code-quote">'NO_AVAILABLE_VALUE'</span>, <span class="code-quote">'ccd'</span>: 3, <span class="code-quote">'filter'</span>: <span class="code-quote">'b'</span>, <span class="code-quote">'expTime'</span>: 0.0, <span class="code-quote">'dataType'</span>: <span class="code-quote">'BIAS'</span>, <span class="code-quote">'taiObs'</span>: <span class="code-quote">'2020-11-20T16:05:41.683'</span>, <span class="code-quote">'pfsDesignId'</span>: 1152921504606846976, <span class="code-quote">'slitOffset'</span>: 0.0}, tag=set()) --&gt; Need to rebuild obs_pfs, to generate defects files. (lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-655 $ rm -r /projects/HSC/PFS/LAM/CALIB-price/ (lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-655 $ mkdir /projects/HSC/PFS/LAM/CALIB-price (lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-655 $ ingestPfsCalibs.py /projects/HSC/PFS/LAM/ --calib /projects/HSC/PFS/LAM/CALIB-price --validity=1800 --doraise --mode=copy /projects/HSC/PFS/LAM/rerun/price/pipe2d-655/BIAS/pfsBias-*.fits (lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-655 $ constructPfsDark.py /projects/HSC/PFS/LAM --calib /projects/HSC/PFS/LAM/CALIB-price --rerun price/pipe2d-655 --id visit=23575 --cores 10 (lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-655 $ ingestPfsCalibs.py /projects/HSC/PFS/LAM/ --calib /projects/HSC/PFS/LAM/CALIB-price --validity=1800 --doraise --mode=copy /projects/HSC/PFS/LAM/rerun/price/pipe2d-655/DARK/pfsDark-2020-10-29-023575-b2.fits (lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-655 $ constructFiberFlat.py /projects/HSC/PFS/LAM --calib /projects/HSC/PFS/LAM/CALIB-price --rerun price/pipe2d-655 --id visit=23592..23596 arm=b --cores 10 Breaks because it needs a detectorMap (though it shouldn't.... fixed). But it looks like we don<span class="code-quote">'t really have any good dithered quartzes, so let'</span>s skip that. (lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-655 $ constructFiberProfiles.py /projects/HSC/PFS/LAM --calib /projects/HSC/PFS/LAM/CALIB-price --rerun price/pipe2d-655 --id visit=23598 arm=b -c isr.doFlat=False --cores 10 Needs a detectorMap, <span class="code-keyword">for</span> real <span class="code-keyword">this</span> time (because we need to transfer the fiberId values from the detectorMap to the fiberProfiles). <span class="code-keyword">import</span> re <span class="code-keyword">import</span> astropy.io.fits <span class="code-keyword">for</span> arm in <span class="code-quote">"brnm"</span>: with astropy.io.fits.open(f<span class="code-quote">"detectorMap-sim-{arm}1.fits"</span>) as fits: ccd = dict(b=0, r=1, n=2, m=3)[arm] card = fits[0].header[<span class="code-quote">"CALIB_ID"</span>] fits[0].header[<span class="code-quote">"CALIB_ID"</span>] = re.sub(<span class="code-quote">"spectrograph=1 ccd=\d"</span>, f<span class="code-quote">"spectrograph=2 ccd={ccd}"</span>, card) fits.writeto(f<span class="code-quote">"detectorMap-sim-{arm}2.fits"</span>) (lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-655 $ ingestPfsCalibs.py /projects/HSC/PFS/LAM --calib /projects/HSC/PFS/LAM/CALIB-price --validity=1800 --mode=copy drp_pfs_data/detectorMap/detectorMap-sim-*.fits constructFiberProfiles works now. </pre> </div></div> <p>Merged to master.</p> Relates PIPE2D-702 Development Rank 0|02qps2:w Reviewers hassan Sprint 2DDRP-2021 A