Uploaded image for project: 'DRP 2-D Pipeline'
  1. DRP 2-D Pipeline
  2. PIPE2D-481

Problems generating flat calibration data

    XMLWordPrintable

    Details

    • Type: Story
    • Status: Won't Fix (View Workflow)
    • Priority: Normal
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      2
    • Sprint:
      2DDRP-2019 J, 2DDRP-2019 K, 2DDRP-2021 A

      Description

      This is on behalf of fmadec who on 2019-11-13 reported the issue on the drp-2d channel on slack when trying to produce a flat calib:

      but CameraMapper INFO: Loading calib registry from /home/fmadec/pfs/drpData/CALIB/calibRegistry.sqlite3
      14881 INFO  2019-11-13T17:19:16.649+0100 CameraMapper: Loading calib registry from /home/fmadec/pfs/drpData/CALIB/calibRegistry.sqlite3
      fiberFlat INFO: Scatter combination
      fiberFlat INFO: Combining 129 inputs {'arm': 'r', 'spectrograph': 1, 'ccd': 1, 'filter': 'b', 'calibDate': '2019-07-25', 'visit0': 21127} on pfslam:14880
      fiberFlat INFO: Dither values: [-0.20349, -0.20347, -0.19332, -0.19331, -0.18314, -0.17297, -0.16279, -0.15262, -0.14244, -0.13227, -0.12209, -0.11192, -0.10174, -0.09157, -0.08139, -0.07122, -0.06105, -0.06104, -0.05087, -0.0407, -0.03052, -0.02035, -0.01018, 0.0, 0.01017, 0.02035, 0.03052, 0.04069, 0.05087, 0.06104, 0.07122, 0.08139, 0.09157, 0.10174, 0.11191, 0.12209, 0.13226, 0.14244, 0.15261, 0.16279, 0.17296, 0.18314, 0.19331, 0.20348]
      fiberFlat INFO: 10 FiberTraces found for DataId(initialdata={'visit': 21128, 'arm': 'r', 'dateObs': '2019-07-25', 'site': 'L', 'category': 'A', 'spectrograph': 1, 'field': 'FLAT', 'ccd': 1, 'filter': 'r', 'expTime': 14.996, 'dataType': 'flat', 'taiObs': '2019-07-25', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set())
      fiberFlat INFO: 10 FiberTraces found for DataId(initialdata={'visit': 21132, 'arm': 'r', 'dateObs': '2019-07-25', 'site': 'L', 'category': 'A', 'spectrograph': 1, 'field': 'FLAT', 'ccd': 1, 'filter': 'r', 'expTime': 14.996, 'dataType': 'flat', 'taiObs': '2019-07-25', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set())
      Exception on pfslam:14880 in reduce: 
        File "src/math/CurveFitting.cc", line 326, in std::tuple<float, ImageT, ImageT, ImageT> pfs::drp::stella::math::{anonymous}::fitProfile1d(const ndarray::ArrayRef<const ImageT, 1, 1>&, const ndarray::ArrayRef<const ImageT, 1, 1>&, const ndarray::ArrayRef<bool, 1, 1>&, const ndarray::ArrayRef<ImageT, 1, 1>&, float, bool) [with ImageT = float]
          fitProfile1d:: i = 18: ERROR: dataVar(i) is not finite {0}
      lsst::pex::exceptions::Exception: 'fitProfile1d:: i = 18: ERROR: dataVar(i) is not finite'
      

      The command-line invocation was not explicitly mentioned, but inferring from earlier comments I believe it was:

      pfs_build_calibs.sh -n -c 8 -r calibs -C DATA/CALIB -b visit=16562..16576 -d visit=16577..16606 -f 'visit=16612..16740 arm=r' -F 'visit=16607..16611 arm=r' DATA
      

      price posted on slack that this problem may be fixed following PIPE2D-391, but as that is a separate issue this ticket is raised to ensure this specific problem is tracked.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                price price
                Reporter:
                hassan hassan
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: