https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-1189 DRP 2-D Pipeline <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> $ fitFluxCal.py /work/drp --calib=/work/drp/CALIB --rerun=test01 --no-versions --clobber-config --id visit=82905 <span class="code-quote">'spectrograph=1^3'</span> [...] fitFluxCal FATAL: Failed on dataId={<span class="code-quote">'visit'</span>: 82905, <span class="code-quote">'spectrograph'</span>: 3, <span class="code-quote">'dateObs'</span>: <span class="code-quote">'2022-11-18'</span>}: KeyError: <span class="code-quote">'NO_DATA'</span> Traceback (most recent call last): File <span class="code-quote">"/work/stack_INFRA-312/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/cmdLineTask.py"</span>, line 436, in __call__ result = self.runTask(task, dataRef, kwargs) File <span class="code-quote">"/work/stack_INFRA-312/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/cmdLineTask.py"</span>, line 504, in runTask <span class="code-keyword">return</span> task.runDataRef(dataRef, **kwargs) File <span class="code-quote">"/work/takuji/pipeline/drp_stella/python/pfs/drp/stella/fitFluxCal.py"</span>, line 206, in runDataRef outputs = self.run(pfsMerged, pfsMergedLsf, references, pfsConfig, pfsArmList, sky1dList) File <span class="code-quote">"/work/takuji/pipeline/drp_stella/python/pfs/drp/stella/fitFluxCal.py"</span>, line 130, in run extracted.fluxTable = self.fluxTable.run( File <span class="code-quote">"/work/takuji/pipeline/drp_stella/python/pfs/drp/stella/FluxTableTask.py"</span>, line 37, in run <span class="code-keyword">return</span> makeFluxTable(identities, spectra, self.config.ignoreFlags, File <span class="code-quote">"/work/takuji/pipeline/drp_stella/python/pfs/drp/stella/makeFluxTable.py"</span>, line 161, in makeFluxTable maskVal = flags.get(<span class="code-quote">"NO_DATA"</span>, *ignoreFlags) File <span class="code-quote">"/work/takuji/pipeline/datamodel/python/pfs/datamodel/masks.py"</span>, line 47, in get <span class="code-keyword">return</span> sum(self[name] <span class="code-keyword">for</span> name in args) File <span class="code-quote">"/work/takuji/pipeline/datamodel/python/pfs/datamodel/masks.py"</span>, line 47, in &lt;genexpr&gt; <span class="code-keyword">return</span> sum(self[name] <span class="code-keyword">for</span> name in args) File <span class="code-quote">"/work/takuji/pipeline/datamodel/python/pfs/datamodel/masks.py"</span>, line 35, in __getitem__ <span class="code-keyword">return</span> 2**self.flags[name] KeyError: <span class="code-quote">'NO_DATA'</span> </pre> </div></div> <p>This looks like a bug from a corner case: it's iterating over a fiber that doesn't have any data associated with it.</p> PIPE2D-1189

fitFluxCal fails on making flux table

Story Normal Done Done price Takuji Yamashita Mon, 20 Mar 2023 14:28:54 +0000 Mon, 20 Mar 2023 18:44:43 +0000 Mon, 20 Mar 2023 18:44:43 +0000 0 1 <p>I've fixed the error by reducing the selection of fibers to those that are available, but the root of the problem is the use of <tt>spectrograph=1^3</tt> in the <tt>&#45;&#45;id</tt> specification. Since the input to the task is a visit, this gets parsed as one visit with <tt>spectrograph=1</tt> and one visit with <tt>spectrograph=3</tt>. There is a warning in the log:</p> <div class="code panel" style="border-width: 1px;"><div class="codeContent panelContent"> <pre class="code-java"> root WARN: Unexpected ID spectrograph; guessing type is <span class="code-quote">"str"</span> </pre> </div></div> <p>That's not exactly clear, and this behaviour is not really what we want, but since we're going to be dumping the Gen2 middleware soon-ish, I'm not going to go to the trouble of discovering what the proper fix should be. Users should take note that sub-components of a visit should not be specified for <tt>fitFluxCal.py</tt>.</p> <p>Merged.</p> Development Rank 0|zzswk7: