https://pfspipe.ipmu.jp/jira This file is an XML representation of an issue en-us 8.3.4 803005 13-09-2019 https://pfspipe.ipmu.jp/jira/browse/PIPE2D-496 DRP 2-D Pipeline <p>i'm running  ics_drp_full:latest  on shell-ics</p> <p> </p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>docker run -ti --net ipfs -v /data:/data -v /software:/software ics_drp_full:latest</pre> </div></div> <p>I've started a fresh new repo, here's my command history</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>1  setup pfs_pipe2d 2  rm -rf /data/drp/alefur/ 3  mkdir /data/drp/alefur 4  echo lsst.obs.pfs.PfsMapper &gt; /data/drp/alefur/_mapper 5  ingestPfsImages.py /data/drp/alefur --mode=link --pfsConfigDir=/data/drp/pfsDesign /data/pfs/2019-12-17/PFSA000*.fits 6  mkdir /data/drp/alefur/CALIB 7  ingestCalibs.py /data/drp/alefur  --calib /data/drp/alefur/CALIB --validity 1000 --mode=copy $DRP_PFS_DATA_DIR/detectorMap/detectorMap-2019Jul-* 8  constructPfsBias.py /data/drp/alefur --calib /data/drp/alefur/CALIB --rerun calib0 --id visit=88..102 --batch-type=smp --cores 2 --doraise </pre> </div></div> <p>ingestPfsImages.py went ok, i'm not copying over all the logs, just the end:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>ingestPfs INFO: /data/pfs/2019-12-17/PFSA00045612.fits --&lt;link&gt;--&gt; /data/drp/alefur/2019-12-17/PFSA000456r1.fits ingestPfs INFO: /data/pfs/2019-12-17/PFSA00045711.fits --&lt;link&gt;--&gt; /data/drp/alefur/2019-12-17/PFSA000457b1.fits ingestPfs INFO: /data/drp/pfsDesign/pfsConfig-0x0100000000000000-000457.fits --&lt;link&gt;--&gt; /data/drp/alefur/pfsConfig/2019-12-17/pfsConfig-0x0100000000000000-000457.fits ingestPfs INFO: /data/pfs/2019-12-17/PFSA00045712.fits --&lt;link&gt;--&gt; /data/drp/alefur/2019-12-17/PFSA000457r1.fits    </pre> </div></div> <p>Then, i've ingested detectorMaps, it went OK as well</p> <p>constructPfsBias.py started OK as well, but failed in the end:</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>50 INFO  2019-12-18T02:51:50.495Z bias: Processing DataId(initialdata={'visit': 101, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1, 'filter': 'r', 'ex pTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set()) on 99a9b9bb7f3b:50                                                                                 50 INFO  2019-12-18T02:51:50.497Z bias.isr: Performing ISR on sensor DataId(initialdata={'visit': 101, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1, 'filter': 'r', 'expTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set())                                                                                  50 INFO  2019-12-18T02:51:50.785Z bias.isr: Converting exposure to floating point values 50 INFO  2019-12-18T02:51:51.556Z bias.isr: Assembling CCD from amplifiers 50 INFO  2019-12-18T02:51:52.797Z bias.isr: Masking defects. 50 INFO  2019-12-18T02:51:52.798Z bias.isr: Masking NAN value pixels. 50 INFO  2019-12-18T02:51:52.843Z bias.isr: Widening saturation trails. 50 INFO  2019-12-18T02:51:52.882Z bias.isr: Interpolating masked pixels. 50 WARN  2019-12-18T02:51:55.082Z bias.isr: No rough magnitude zero point set for filter r 50 WARN  2019-12-18T02:51:55.083Z bias.isr: Non-positive exposure time; skipping rough zero point 50 INFO  2019-12-18T02:52:00.421Z bias: Processing DataId(initialdata={'visit': 102, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1, 'filter': 'r', 'ex pTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set()) on 99a9b9bb7f3b:50                                                                                 50 INFO  2019-12-18T02:52:00.422Z bias.isr: Performing ISR on sensor DataId(initialdata={'visit': 102, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1, 'filter': 'r', 'expTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set())                                                                                  50 INFO  2019-12-18T02:52:00.706Z bias.isr: Converting exposure to floating point values 50 INFO  2019-12-18T02:52:01.463Z bias.isr: Assembling CCD from amplifiers 50 INFO  2019-12-18T02:52:02.699Z bias.isr: Masking defects. 50 INFO  2019-12-18T02:52:02.700Z bias.isr: Masking NAN value pixels. 50 INFO  2019-12-18T02:52:02.744Z bias.isr: Widening saturation trails. 50 INFO  2019-12-18T02:52:02.781Z bias.isr: Interpolating masked pixels. 50 WARN  2019-12-18T02:52:04.992Z bias.isr: No rough magnitude zero point set for filter r 50 WARN  2019-12-18T02:52:04.992Z bias.isr: Non-positive exposure time; skipping rough zero point bias INFO: Scale on 99a9b9bb7f3b:49 CameraMapper INFO: Loading exposure registry from /data/drp/alefur/registry.sqlite3 CameraMapper INFO: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3 50 INFO  2019-12-18T02:52:10.378Z CameraMapper: Loading exposure registry from /data/drp/alefur/registry.sqlite3                                                                                                         50 INFO  2019-12-18T02:52:10.380Z CameraMapper: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3                                                                                                 CameraMapper INFO: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3 50 INFO  2019-12-18T02:52:10.845Z CameraMapper: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3                                                                                                 bias INFO: Scatter combination bias INFO: Combining {'arm': 'b', 'spectrograph': 1, 'ccd': 0, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:49                                                                             50 INFO  2019-12-18T02:52:11.406Z bias: Combining {'arm': 'r', 'spectrograph': 1, 'ccd': 1, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:50                                                bias INFO: Writing {'arm': 'b', 'spectrograph': 1, 'ccd': 0, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:49                                                                               50 INFO  2019-12-18T02:53:50.205Z bias: Writing {'arm': 'r', 'spectrograph': 1, 'ccd': 1, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:50                                                  bias WARN: Unable to create camera image: 'PfsMapper' object has no attribute 'map_bias_camera' </pre> </div></div> <p> </p> PIPE2D-496

Suppress warnings about missing map_bias_camera in constructBias

Bug Normal Won't Fix Won't Fix price arnaud.lefur Wed, 18 Dec 2019 02:58:21 +0000 Mon, 4 Jan 2021 20:22:49 +0000 Tue, 5 May 2020 19:00:39 +0000 0 3 <p>That a WARNing... the bias is made. Look in $RERUN/BIAS/</p> <p>The warning is <tt>bias WARN: Unable to create camera image: 'PfsMapper' object has no attribute 'map_bias_camera'</tt> and it means that we failed to make a png of the bias frame.</p> <p><a href="https://pfspipe.ipmu.jp/jira/secure/ViewProfile.jspa?name=price" class="user-hover" rel="price">price</a>: we need to add the mapper or remove this warning.</p> <p>Sorry, i've misread, my bad ...</p> <p>constructPfsDark.py is also working, same warning message.</p> <p>So, I've tried :</p> <div class="preformatted panel" style="border-width: 1px;"><div class="preformattedContent panelContent"> <pre>detrend.py /data/drp/alefur --calib /data/drp/alefur/CALIB --rerun test/detrend --id visit=114 --config isr.doBias=True --config isr.doDark=True --config isr.doFlat=False </pre> </div></div> <p>and it worked fine, (not an existing) problem solve <img class="emoticon" src="https://pfspipe.ipmu.jp/jira/images/icons/emoticons/wink.png" height="16" width="16" align="absmiddle" alt="" border="0"/></p> <p> </p> <p>Also I think that displaying the full path of the just created file would be somehow reassuring, at least you know that some file has indeed been created.</p> <p><img class="emoticon" src="https://pfspipe.ipmu.jp/jira/images/icons/emoticons/add.png" height="16" width="16" align="absmiddle" alt="" border="0"/></p> <p>Replaced by ticket <a href="https://pfspipe.ipmu.jp/jira/browse/PIPE2D-572" title="Remove &#39;Unable to create camera image warnings&#39;" class="issue-link" data-issue-key="PIPE2D-572"><del>PIPE2D-572</del></a>.</p> Relates PIPE2D-572 Development Rank 0|02qprx: Sprint 2DDRP-2020 A 2DDRP-2021 A Story Points 1.0