Uploaded image for project: 'DRP 2-D Pipeline'
  1. DRP 2-D Pipeline
  2. PIPE2D-496

Suppress warnings about missing map_bias_camera in constructBias

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Won't Fix (View Workflow)
    • Priority: Normal
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      1
    • Sprint:
      2DDRP-2020 A, 2DDRP-2021 A

      Description

      i'm running  ics_drp_full:latest  on shell-ics

       

      docker run -ti --net ipfs -v /data:/data -v /software:/software ics_drp_full:latest

      I've started a fresh new repo, here's my command history

      1  setup pfs_pipe2d
2  rm -rf /data/drp/alefur/
3  mkdir /data/drp/alefur
4  echo lsst.obs.pfs.PfsMapper > /data/drp/alefur/_mapper
5  ingestPfsImages.py /data/drp/alefur --mode=link --pfsConfigDir=/data/drp/pfsDesign /data/pfs/2019-12-17/PFSA000*.fits
6  mkdir /data/drp/alefur/CALIB
7  ingestCalibs.py /data/drp/alefur  --calib /data/drp/alefur/CALIB --validity 1000 --mode=copy $DRP_PFS_DATA_DIR/detectorMap/detectorMap-2019Jul-*
8  constructPfsBias.py /data/drp/alefur --calib /data/drp/alefur/CALIB --rerun calib0 --id visit=88..102 --batch-type=smp --cores 2 --doraise

      ingestPfsImages.py went ok, i'm not copying over all the logs, just the end:

      ingestPfs INFO: /data/pfs/2019-12-17/PFSA00045612.fits --<link>--> /data/drp/alefur/2019-12-17/PFSA000456r1.fits
ingestPfs INFO: /data/pfs/2019-12-17/PFSA00045711.fits --<link>--> /data/drp/alefur/2019-12-17/PFSA000457b1.fits
ingestPfs INFO: /data/drp/pfsDesign/pfsConfig-0x0100000000000000-000457.fits --<link>--> /data/drp/alefur/pfsConfig/2019-12-17/pfsConfig-0x0100000000000000-000457.fits
ingestPfs INFO: /data/pfs/2019-12-17/PFSA00045712.fits --<link>--> /data/drp/alefur/2019-12-17/PFSA000457r1.fits   

      Then, i've ingested detectorMaps, it went OK as well

      constructPfsBias.py started OK as well, but failed in the end:

      50 INFO  2019-12-18T02:51:50.495Z bias: Processing DataId(initialdata={'visit': 101, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1, 'filter': 'r', 'ex
pTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set()) on 99a9b9bb7f3b:50                                                                                
50 INFO  2019-12-18T02:51:50.497Z bias.isr: Performing ISR on sensor DataId(initialdata={'visit': 101, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1,

'filter': 'r', 'expTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set())                                                                                 
50 INFO  2019-12-18T02:51:50.785Z bias.isr: Converting exposure to floating point values

50 INFO  2019-12-18T02:51:51.556Z bias.isr: Assembling CCD from amplifiers

50 INFO  2019-12-18T02:51:52.797Z bias.isr: Masking defects.

50 INFO  2019-12-18T02:51:52.798Z bias.isr: Masking NAN value pixels.

50 INFO  2019-12-18T02:51:52.843Z bias.isr: Widening saturation trails.

50 INFO  2019-12-18T02:51:52.882Z bias.isr: Interpolating masked pixels.

50 WARN  2019-12-18T02:51:55.082Z bias.isr: No rough magnitude zero point set for filter r

50 WARN  2019-12-18T02:51:55.083Z bias.isr: Non-positive exposure time; skipping rough zero point

50 INFO  2019-12-18T02:52:00.421Z bias: Processing DataId(initialdata={'visit': 102, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1, 'filter': 'r', 'ex
pTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set()) on 99a9b9bb7f3b:50                                                                                
50 INFO  2019-12-18T02:52:00.422Z bias.isr: Performing ISR on sensor DataId(initialdata={'visit': 102, 'dateObs': '2019-12-17', 'site': 'S', 'category': 'A', 'arm': 'r', 'spectrograph': 1, 'field': 'BIAS', 'ccd': 1,

'filter': 'r', 'expTime': 0.0, 'dataType': 'bias', 'taiObs': '2019-12-17', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set())                                                                                 
50 INFO  2019-12-18T02:52:00.706Z bias.isr: Converting exposure to floating point values

50 INFO  2019-12-18T02:52:01.463Z bias.isr: Assembling CCD from amplifiers

50 INFO  2019-12-18T02:52:02.699Z bias.isr: Masking defects.

50 INFO  2019-12-18T02:52:02.700Z bias.isr: Masking NAN value pixels.

50 INFO  2019-12-18T02:52:02.744Z bias.isr: Widening saturation trails.

50 INFO  2019-12-18T02:52:02.781Z bias.isr: Interpolating masked pixels.

50 WARN  2019-12-18T02:52:04.992Z bias.isr: No rough magnitude zero point set for filter r

50 WARN  2019-12-18T02:52:04.992Z bias.isr: Non-positive exposure time; skipping rough zero point

bias INFO: Scale on 99a9b9bb7f3b:49

CameraMapper INFO: Loading exposure registry from /data/drp/alefur/registry.sqlite3

CameraMapper INFO: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3

50 INFO  2019-12-18T02:52:10.378Z CameraMapper: Loading exposure registry from /data/drp/alefur/registry.sqlite3                                                                                                        
50 INFO  2019-12-18T02:52:10.380Z CameraMapper: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3                                                                                                
CameraMapper INFO: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3

50 INFO  2019-12-18T02:52:10.845Z CameraMapper: Loading calib registry from /data/drp/alefur/CALIB/calibRegistry.sqlite3                                                                                                
bias INFO: Scatter combination

bias INFO: Combining {'arm': 'b', 'spectrograph': 1, 'ccd': 0, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:49                                                                            
50 INFO  2019-12-18T02:52:11.406Z bias: Combining {'arm': 'r', 'spectrograph': 1, 'ccd': 1, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:50                                               
bias INFO: Writing {'arm': 'b', 'spectrograph': 1, 'ccd': 0, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:49                                                                              
50 INFO  2019-12-18T02:53:50.205Z bias: Writing {'arm': 'r', 'spectrograph': 1, 'ccd': 1, 'filter': 'NONE', 'calibDate': '2019-12-17', 'visit0': 88} on 99a9b9bb7f3b:50                                                 
bias WARN: Unable to create camera image: 'PfsMapper' object has no attribute 'map_bias_camera'

       

        Attachments

          Issue Links

          relates to

          Task - A task that needs to be done. PIPE2D-572 Remove 'Unable to create camera image warnings'

          • Normal - Normal priorities
          • Done

            Activity

              People

              • Assignee:
                price price
                Reporter:
                arnaud.lefur arnaud.lefur
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: