https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1220 DRP 2-D Pipeline <p>During the 2023 Apr/May engineering run, we <a href="https://sumire.pbworks.com/w/page/152988447/Calibration%20Data%20from%20Run%2011" class="external-link" rel="nofollow">obtained data</a> from which to generate fiber profiles for b/r 1/3. Some limited data was also acquired for m 1/3. Build fiber profiles and install in a new calib repository (<a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1216" title="Create calibs in support of 2023 Apr/May engineering run" class="issue-link" data-issue-key="PIPE2D-1216"><del>PIPE2D-1216</del></a>).</p> <p>C</p> PIPE2D-1220

Create fiberProfiles from 2023 Apr/May engineering data

Story Normal Done Done price price Fri, 12 May 2023 17:50:13 +0000 Fri, 26 May 2023 15:41:04 +0000 Fri, 26 May 2023 15:41:04 +0000 0 1 <p>From my notes:</p> <blockquote> <p>May as well rebuild the fiber profiles we built during the run, with the latest code (e.g., crosstalk corrections). Using branch tickets/<a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1209" title="Optimize reduceProfiles" class="issue-link" data-issue-key="PIPE2D-1209"><del>PIPE2D-1209</del></a> (reduceProfile optimisations).</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> reduceProfiles.py /work/drp --calib=/work/price/CALIB-202304-eng --rerun=price/pipe2d-1220 --id visit=92413..92417^92419..92425^92317..92323^92251..92257^91942..91946^92272..92278^92330..92336 --normId visit=91907..91909 -j 4 -c profiles.profileRadius=10 profiles.profileOversample=3 profiles.profileSwath=2000 profiles.profileRejThresh=5 reduceExposure.isr.doFlat=False </pre> </div></div> <p>Looks good, like before.</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> sqlite&gt; DELETE FROM fiberProfiles WHERE arm in (<span class="code-quote">"b"</span>, <span class="code-quote">"r"</span>); sqlite&gt; DELETE FROM fiberProfiles_visit WHERE arm in (<span class="code-quote">"b"</span>, <span class="code-quote">"r"</span>); (lsst-scipipe-3.0.0) price@pfsa-usr02-gb:/work/price/CALIB-202304-eng $ rm FIBERPROFILES/*[br]?.fits (lsst-scipipe-3.0.0) price@pfsa-usr02-gb:/work/price/CALIB-202304-eng $ ingestPfsCalibs.py /work/drp --calib /work/drp/CALIB /work/drp/rerun/price/pipe2d-1220/FIBERPROFILES/pfsFiberProfiles-2023-04-26-091942-*.fits --validity 10000 -c clobber=True --mode=copy </pre> </div></div> <p>For m, we don't have a full dataset: just one set of mod4 and one set with all fibers hidden. I'm going to try it, with a reduced profile radius, but I don't have high hopes of it being particularly successful.</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> reduceProfiles.py /work/drp --calib=/work/price/CALIB-202304-eng --rerun=price/pipe2d-1220 --id visit=92237..92241^92258..92262 arm=m --normId visit=91427..91436 arm=m -j 2 -c profiles.profileRadius=4 profiles.profileOversample=3 profiles.profileSwath=2000 profiles.profileRejThresh=5 reduceExposure.isr.doFlat=False --no-versions </pre> </div></div> <p>Hmm. reduceProfiles doesn't work if there isn't an existing fiberProfiles in the calib registry, because it uses the fiberProfiles as part of reducing the individual exposures (e.g., centroiding on arc lines).<br/> And the exposures being used for normalisation used the ring lamp, so they're coming up as sky exposures, not quartzes.<br/> And for some reason, the m1 fiberProfiles is getting written with a date from 2022, not 2023.</p> <p>Fixed all that.<br/> But the m profiles are pretty rubbish. Not going any further with them.</p></blockquote> <p>These calibs were installed in <tt>CALIB-2023-04-v1</tt>.</p> Development Rank 0|zzsx67: