[PIPE2D-496] Suppress warnings about missing map_bias_camera in constructBias Created: 18/Dec/19  Updated: 05/Jan/21  Resolved: 06/May/20

Status: Won't Fix
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Normal
Reporter: arnaud.lefur Assignee: price
Resolution: Won't Fix Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Relates
relates to PIPE2D-572 Remove 'Unable to create camera image... Done
Story Points: 1
Sprint: 2DDRP-2020 A, 2DDRP-2021 A

 Description   

i'm running  ics_drp_full:latest  on shell-ics

 

docker run -ti --net ipfs -v /data:/data -v /software:/software ics_drp_full:latest

I've started a fresh new repo, here's my command history

1  setup pfs_pipe2d
2  rm -rf /data/drp/alefur/
3  mkdir /data/drp/alefur
4  echo lsst.obs.pfs.PfsMapper > /data/drp/alefur/_mapper
5  ingestPfsImages.py /data/drp/alefur --mode=link --pfsConfigDir=/data/drp/pfsDesign /data/pfs/2019-12-17/PFSA000*.fits
6  mkdir /data/drp/alefur/CALIB
7  ingestCalibs.py /data/drp/alefur  --calib /data/drp/alefur/CALIB --validity 1000 --mode=copy $DRP_PFS_DATA_DIR/detectorMap/detectorMap-2019Jul-*
8  constructPfsBias.py /data/drp/alefur --calib /data/drp/alefur/CALIB --rerun calib0 --id visit=88..102 --batch-type=smp --cores 2 --doraise

ingestPfsImages.py went ok, i'm not copying over all the logs, just the end:

ingestPfs INFO: /data/pfs/2019-12-17/PFSA00045612.fits --<link>--> /data/drp/alefur/2019-12-17/PFSA000456r1.fits
ingestPfs INFO: /data/pfs/2019-12-17/PFSA00045711.fits --<link>--> /data/drp/alefur/2019-12-17/PFSA000457b1.fits
ingestPfs INFO: /data/drp/pfsDesign/pfsConfig-0x0100000000000000-000457.fits --<link>--> /data/drp/alefur/pfsConfig/2019-12-17/pfsConfig-0x0100000000000000-000457.fits
ingestPfs INFO: /data/pfs/2019-12-17/PFSA00045712.fits --<link>--> /data/drp/alefur/2019-12-17/PFSA000457r1.fits   

Then, i've ingested detectorMaps, it went OK as well

constructPfsBias.py started OK as well, but failed in the end:

50 INFO  2019-12-18T02:51:50.495Z bias: Processing DataId(initialdata={'visit': 101, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1, 'filter': 'r', 'ex
pTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set()) on 99a9b9bb7f3b:50                                                                                
50 INFO  2019-12-18T02:51:50.497Z bias.isr: Performing ISR on sensor DataId(initialdata={'visit': 101, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1,

'filter': 'r', 'expTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set())                                                                                 
50 INFO  2019-12-18T02:51:50.785Z bias.isr: Converting exposure to floating point values

50 INFO  2019-12-18T02:51:51.556Z bias.isr: Assembling CCD from amplifiers

50 INFO  2019-12-18T02:51:52.797Z bias.isr: Masking defects.

50 INFO  2019-12-18T02:51:52.798Z bias.isr: Masking NAN value pixels.

50 INFO  2019-12-18T02:51:52.843Z bias.isr: Widening saturation trails.

50 INFO  2019-12-18T02:51:52.882Z bias.isr: Interpolating masked pixels.

50 WARN  2019-12-18T02:51:55.082Z bias.isr: No rough magnitude zero point set for filter r

50 WARN  2019-12-18T02:51:55.083Z bias.isr: Non-positive exposure time; skipping rough zero point

50 INFO  2019-12-18T02:52:00.421Z bias: Processing DataId(initialdata={'visit': 102, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1, 'filter': 'r', 'ex
pTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set()) on 99a9b9bb7f3b:50                                                                                
50 INFO  2019-12-18T02:52:00.422Z bias.isr: Performing ISR on sensor DataId(initialdata={'visit': 102, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1,

'filter': 'r', 'expTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set())                                                                                 
50 INFO  2019-12-18T02:52:00.706Z bias.isr: Converting exposure to floating point values

50 INFO  2019-12-18T02:52:01.463Z bias.isr: Assembling CCD from amplifiers

50 INFO  2019-12-18T02:52:02.699Z bias.isr: Masking defects.

50 INFO  2019-12-18T02:52:02.700Z bias.isr: Masking NAN value pixels.

50 INFO  2019-12-18T02:52:02.744Z bias.isr: Widening saturation trails.

50 INFO  2019-12-18T02:52:02.781Z bias.isr: Interpolating masked pixels.

50 WARN  2019-12-18T02:52:04.992Z bias.isr: No rough magnitude zero point set for filter r

50 WARN  2019-12-18T02:52:04.992Z bias.isr: Non-positive exposure time; skipping rough zero point

bias INFO: Scale on 99a9b9bb7f3b:49

CameraMapper INFO: Loading exposure registry from /data/drp/alefur/registry.sqlite3

CameraMapper INFO: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3

50 INFO  2019-12-18T02:52:10.378Z CameraMapper: Loading exposure registry from /data/drp/alefur/registry.sqlite3                                                                                                        
50 INFO  2019-12-18T02:52:10.380Z CameraMapper: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3                                                                                                
CameraMapper INFO: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3

50 INFO  2019-12-18T02:52:10.845Z CameraMapper: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3                                                                                                
bias INFO: Scatter combination

bias INFO: Combining {'arm': 'b', 'spectrograph': 1, 'ccd': 0, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:49                                                                            
50 INFO  2019-12-18T02:52:11.406Z bias: Combining {'arm': 'r', 'spectrograph': 1, 'ccd': 1, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:50                                               
bias INFO: Writing {'arm': 'b', 'spectrograph': 1, 'ccd': 0, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:49                                                                              
50 INFO  2019-12-18T02:53:50.205Z bias: Writing {'arm': 'r', 'spectrograph': 1, 'ccd': 1, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:50                                                 
bias WARN: Unable to create camera image: 'PfsMapper' object has no attribute 'map_bias_camera'

 

 Comments   
Comment by cloomis [ 18/Dec/19 ]

That a WARNing... the bias is made. Look in $RERUN/BIAS/

Comment by rhl [ 18/Dec/19 ]

The warning is bias WARN: Unable to create camera image: 'PfsMapper' object has no attribute 'map_bias_camera' and it means that we failed to make a png of the bias frame.

price: we need to add the mapper or remove this warning.

Comment by arnaud.lefur [ 18/Dec/19 ]

Sorry, i've misread, my bad ...

constructPfsDark.py is also working, same warning message.

So, I've tried :

detrend.py /data/drp/alefur --calib /data/drp/alefur/CALIB --rerun test/detrend --id visit=114 --config isr.doBias=True --config isr.doDark=True --config isr.doFlat=False

and it worked fine, (not an existing) problem solve

 

Comment by arnaud.lefur [ 18/Dec/19 ]

Also I think that displaying the full path of the just created file would be somehow reassuring, at least you know that some file has indeed been created.

Comment by hassan [ 06/May/20 ]

Replaced by ticket PIPE2D-572.

Generated at Sat Feb 10 15:54:04 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.