[PIPE2D-481] Problems generating flat calibration data Created: 27/Nov/19  Updated: 05/Jan/21  Resolved: 12/Feb/20

Status: Won't Fix
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Story Priority: Normal
Reporter: hassan Assignee: price
Resolution: Won't Fix Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
duplicates PIPE2D-507 ConstructFiberFlat.py hangs against S... Done
Relates
relates to PIPE2D-391 Generate fiberTraces from odd/even flats Done
Story Points: 2
Sprint: 2DDRP-2019 J, 2DDRP-2019 K, 2DDRP-2021 A

 Description   

This is on behalf of fmadec who on 2019-11-13 reported the issue on the drp-2d channel on slack when trying to produce a flat calib:

but CameraMapper INFO: Loading calib registry from /home/fmadec/pfs/drpData/CALIB/calibRegistry.sqlite3
14881 INFO  2019-11-13T17:19:16.649+0100 CameraMapper: Loading calib registry from /home/fmadec/pfs/drpData/CALIB/calibRegistry.sqlite3
fiberFlat INFO: Scatter combination
fiberFlat INFO: Combining 129 inputs {'arm': 'r', 'spectrograph': 1, 'ccd': 1, 'filter': 'b', 'calibDate': '2019-07-25', 'visit0': 21127} on pfslam:14880
fiberFlat INFO: Dither values: [-0.20349, -0.20347, -0.19332, -0.19331, -0.18314, -0.17297, -0.16279, -0.15262, -0.14244, -0.13227, -0.12209, -0.11192, -0.10174, -0.09157, -0.08139, -0.07122, -0.06105, -0.06104, -0.05087, -0.0407, -0.03052, -0.02035, -0.01018, 0.0, 0.01017, 0.02035, 0.03052, 0.04069, 0.05087, 0.06104, 0.07122, 0.08139, 0.09157, 0.10174, 0.11191, 0.12209, 0.13226, 0.14244, 0.15261, 0.16279, 0.17296, 0.18314, 0.19331, 0.20348]
fiberFlat INFO: 10 FiberTraces found for DataId(initialdata={'visit': 21128, 'arm': 'r', 'dateObs': '2019-07-25', 'site': 'L', 'category': 'A', 'spectrograph': 1, 'field': 'FLAT', 'ccd': 1, 'filter': 'r', 'expTime': 14.996, 'dataType': 'flat', 'taiObs': '2019-07-25', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set())
fiberFlat INFO: 10 FiberTraces found for DataId(initialdata={'visit': 21132, 'arm': 'r', 'dateObs': '2019-07-25', 'site': 'L', 'category': 'A', 'spectrograph': 1, 'field': 'FLAT', 'ccd': 1, 'filter': 'r', 'expTime': 14.996, 'dataType': 'flat', 'taiObs': '2019-07-25', 'pfsDesignId': 1099528409104, 'slitOffset': 0.0}, tag=set())
Exception on pfslam:14880 in reduce: 
  File "src/math/CurveFitting.cc", line 326, in std::tuple<float, ImageT, ImageT, ImageT> pfs::drp::stella::math::{anonymous}::fitProfile1d(const ndarray::ArrayRef<const ImageT, 1, 1>&, const ndarray::ArrayRef<const ImageT, 1, 1>&, const ndarray::ArrayRef<bool, 1, 1>&, const ndarray::ArrayRef<ImageT, 1, 1>&, float, bool) [with ImageT = float]
    fitProfile1d:: i = 18: ERROR: dataVar(i) is not finite {0}
lsst::pex::exceptions::Exception: 'fitProfile1d:: i = 18: ERROR: dataVar(i) is not finite'

The command-line invocation was not explicitly mentioned, but inferring from earlier comments I believe it was:

pfs_build_calibs.sh -n -c 8 -r calibs -C DATA/CALIB -b visit=16562..16576 -d visit=16577..16606 -f 'visit=16612..16740 arm=r' -F 'visit=16607..16611 arm=r' DATA

price posted on slack that this problem may be fixed following PIPE2D-391, but as that is a separate issue this ticket is raised to ensure this specific problem is tracked.



 Comments   
Comment by hassan [ 12/Feb/20 ]

Work fixed as part of PIPE2D-507.

Generated at Sat Feb 10 15:53:54 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.