https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1291 DRP 2-D Pipeline <p>Jared reports that on tiger, as he's able to successfully access the pfsArm and pfsMerged, he's not able to access the calexp even though the file exist, the butler.get fails with :</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre> NotFoundError: File "src/PropertySet.cc", line 186, in const std::type_info&amp; lsst::daf::base::PropertySet::typeOf(const string&amp;) const CALIB not found {0} lsst::pex::exceptions::NotFoundError: 'CALIB not found' </pre> </div></div> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>rerun : /projects/HSC/PFS/Subaru/rerun/edr3-20230829 dataId: dict(arm='r', visit=98042, spectrograph=1) </pre> </div></div> PIPE2D-1291

Unable to retrieve calexp after reducing exposure

Bug Normal Done Done price arnaud.lefur Wed, 30 Aug 2023 16:40:14 +0000 Wed, 30 Aug 2023 19:28:27 +0000 Wed, 30 Aug 2023 19:28:27 +0000 0 3 <p>Please provide a complete how-to-repeat</p> <p>Just do :<br/> <em>reduceExposure.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB --rerun=pipe2d-1291 -j 8 --id visit=98042 -c isr.doFlat=False</em></p> <p>and then : </p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>import lsst.daf.persistence as dafPersist butler = dafPersist.Butler('/projects/HSC/PFS/Subaru/rerun/pipe2d-1291') butler.get('pfsArm', arm='r', spectrograph=1, visit=98042) # OK butler.get('calexp', arm='r', spectrograph=1, visit=98042) # FAILS </pre> </div></div> <p>This is due to the use of a dotted <tt>HIERARCH</tt> key name (<tt>PFS.DRP2D.CALIB</tt>) when recording the calib path (<a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1281" title="Miscellaneous workshop updates" class="issue-link" data-issue-key="PIPE2D-1281"><del>PIPE2D-1281</del></a>). I'm updating it to use underscores instead of dots (<tt>PFS_DRP2D_CALIB</tt>).</p> <p>Fix is in obs_pfs, and is currently being tested.</p> <p>That requires me to regenerate my own rerun, which is more than is needed to replicate this problem.  So</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> butler = dafPersist.Butler(<span class="code-quote">'/projects/HSC/PFS/Subaru/rerun/edr3-20230829'</span>) butler.get(<span class="code-quote">'calexp'</span>, arm=<span class="code-quote">'r'</span>, spectrograph=1, visit=98042) # FAILS </pre> </div></div> <p>would have been the minimal how-to-repeat. The initial ticket didn't tell me if e.g. a CALIB argument was passed to the butler.</p> <p>But in this case, as so often, Paul's found the real problem</p> <p>Thanks.<br/> Does it mean I need to re-process the data once the fix is in place ? </p> <p>Yes, I'm afraid so.</p> <p>No worries, I did reprocess the data and was able to access the calexp file.<br/> So your fix appears to work, thanks !</p> <p>Integration test passed.<br/> Merged to master.</p> Development Rank 0|zzszdb: