https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-917 DRP 2-D Pipeline <p>Please pull over <a href="https://jira.lsstcorp.org/browse/DM-31448" class="external-link" rel="nofollow">https://jira.lsstcorp.org/browse/DM-31448</a>. It's needed to read arbitrary HDUs for H4RG data</p> PIPE2D-917

Bring over DM-31448 from Rubin (Allow gen2 butler lookups even when fields in the dataId are not in the registry)

Story Normal Done Done price rhl NIR Wed, 20 Oct 2021 16:41:07 +0000 Tue, 19 Jul 2022 19:55:57 +0000 Fri, 10 Dec 2021 23:17:59 +0000 0 1 <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=rhl" class="user-hover" rel="rhl">rhl</a>, could you please check that this works for you? You should only have to switch to the obs_pfs ticket branch.</p> <p>Sorry, I only just got to this. Rebasing my working branch of obs_pfs onto <tt>origin/tickets/<a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-917" title="Bring over DM-31448 from Rubin (Allow gen2 butler lookups even when fields in the dataId are not in the registry)" class="issue-link" data-issue-key="PIPE2D-917"><del>PIPE2D-917</del></a></tt> doesn't seem to work on tiger:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> <span class="code-keyword">import</span> lsst.daf.persistence as dafPersist butler = dafPersist.Butler(<span class="code-quote">"/projects/HSC/PFS/JHU"</span>) dataId = dict(visit=24848, arm=<span class="code-quote">'n'</span>, spectrograph=2) raw = butler.get(<span class="code-quote">'raw'</span>, dataId, hdu=1) </pre> </div></div> <p>generates an error ending with</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> /tigress/HSC/PFS/stack/current/stack/current/Linux64/daf_persistence/18.1.0/python/lsst/daf/persistence/registries.py in lookup(self, lookupProperties, reference, dataId, **kwargs) 367 cmd += <span class="code-quote">" WHERE "</span> + <span class="code-quote">" AND "</span>.join(whereList) 368 cursor = self.conn.cursor() --&gt; 369 cursor.execute(cmd, valueList) 370 <span class="code-keyword">return</span> [row <span class="code-keyword">for</span> row in cursor.fetchall()] 371 OperationalError: no such column: hdu </pre> </div></div> <p>Did I do something wrong? I confirmed that the monkey-patch code was being imported</p> <p>Sorry about that. I needed to bring the subclasses along for the ride. It works now:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> $ python -c <span class="code-quote">'<span class="code-keyword">import</span> lsst.daf.persistence as dafPersist; butler = dafPersist.Butler(<span class="code-quote">"/projects/HSC/PFS/JHU"</span>); dataId = dict(visit=24848, arm=<span class="code-quote">"n"</span>, spectrograph=2); raw = butler.get(<span class="code-quote">"raw"</span>, dataId, hdu=1)'</span> CameraMapper INFO: Loading exposure registry from /projects/HSC/PFS/JHU/registry.sqlite3 CameraMapper INFO: darkTime is NaN/Inf; using exposureTime $ </pre> </div></div> <p>Looks OK. It's not the way I'd have done it, but Paul's Da Boss. We do need to make sure that this gets removed when we go to Gen3.</p> <p>Yeah, it's not ideal, but I'm hoping it's not going to last long.</p> <p>Merged.</p> Blocks INSTRM-1469 Relates PIPE2D-882 Development Rank 0|zzs9ul:xxi Reviewers rhl Sprint 2DDRP-2021 A12 Story Points 1.0