lsst.ctrl.mpexec.mpGraphExecutor INFO: Executed 24 quanta successfully, 0 failed and 3 remain out of total 27 quanta.
py.warnings WARNING: /data22a/mineo/pfswork/pfsrepos/drp_stella/python/pfs/drp/stella/utils/polynomialND.py:76: RuntimeWarning: divide by zero encountered in true_divide
self._scale = 1.0 / (self._max - self._min)
py.warnings WARNING: /data22a/mineo/pfswork/pfsrepos/drp_stella/python/pfs/drp/stella/utils/polynomialND.py:130: RuntimeWarning: invalid value encountered in multiply
x *= scale
lsst.ctrl.mpexec.singleQuantumExecutor ERROR: Execution of task 'fitFluxCal' on quantum {instrument: 'PFS-F', exposure: 24, ...} failed. Exception RuntimeError: No good points
Process task-{instrument: 'PFS-F', exposure: 24, ...}:
Traceback (most recent call last):
File "/data22a/mineo/pfswork/lsst_stack/lsst_home/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-3.0.0/lib/python3.8/multiprocessing/process.py", line 315, in _bootstrap
self.run()
File "/data22a/mineo/pfswork/lsst_stack/lsst_home/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-3.0.0/lib/python3.8/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "/data22a/mineo/pfswork/lsst_stack/lsst_home/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/ctrl_mpexec/gb02ad94e9c+e480a1db32/python/lsst/ctrl/mpexec/mpGraphExecutor.py", line 143, in _executeJob
quantumExecutor.execute(taskDef, quantum, butler)
File "/data22a/mineo/pfswork/lsst_stack/lsst_home/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/ctrl_mpexec/gb02ad94e9c+e480a1db32/python/lsst/ctrl/mpexec/singleQuantumExecutor.py", line 135, in execute
result = self._execute(taskDef, quantum, butler)
File "/data22a/mineo/pfswork/lsst_stack/lsst_home/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/ctrl_mpexec/gb02ad94e9c+e480a1db32/python/lsst/ctrl/mpexec/singleQuantumExecutor.py", line 212, in _execute
self.runQuantum(runTask, quantum, taskDef, butler)
File "/data22a/mineo/pfswork/lsst_stack/lsst_home/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/ctrl_mpexec/gb02ad94e9c+e480a1db32/python/lsst/ctrl/mpexec/singleQuantumExecutor.py", line 580, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File "/data22a/mineo/pfswork/pfsrepos/drp_stella/python/pfs/drp/stella/fitFluxCal.py", line 761, in runQuantum
outputs = self.run(**inputs, pfsArmList=armInputs.pfsArm, sky1dList=armInputs.sky1d)
File "/data22a/mineo/pfswork/pfsrepos/drp_stella/python/pfs/drp/stella/fitFluxCal.py", line 703, in run
fluxCal = self.calculateCalibrations(pfsConfig, pfsMerged, pfsMergedLsf, references)
File "/data22a/mineo/pfswork/pfsrepos/drp_stella/python/pfs/drp/stella/fitFluxCal.py", line 900, in calculateCalibrations
return self.fitFocalPlane.run(
File "/data22a/mineo/pfswork/pfsrepos/drp_stella/python/pfs/drp/stella/fitFocalPlane.py", line 109, in run
raise RuntimeError("No good points")
RuntimeError: No good points
lsst.daf.butler.cli.utils ERROR: Caught an exception, details are in traceback:
Traceback (most recent call last):
File "/data22a/mineo/pfswork/lsst_stack/lsst_home/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/ctrl_mpexec/gb02ad94e9c+e480a1db32/python/lsst/ctrl/mpexec/cli/cmd/commands.py", line 130, in run
script.run(qgraphObj=qgraph, **kwargs)
File "/data22a/mineo/pfswork/lsst_stack/lsst_home/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/ctrl_mpexec/gb02ad94e9c+e480a1db32/python/lsst/ctrl/mpexec/cli/script/run.py", line 187, in run
f.runPipeline(qgraphObj, taskFactory, args)
File "/data22a/mineo/pfswork/lsst_stack/lsst_home/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/ctrl_mpexec/gb02ad94e9c+e480a1db32/python/lsst/ctrl/mpexec/cmdLineFwk.py", line 740, in runPipeline
executor.execute(graph, butler)
File "/data22a/mineo/pfswork/lsst_stack/lsst_home/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/ctrl_mpexec/gb02ad94e9c+e480a1db32/python/lsst/ctrl/mpexec/mpGraphExecutor.py", line 373, in execute
self._executeQuantaMP(graph, butler)
File "/data22a/mineo/pfswork/lsst_stack/lsst_home/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/ctrl_mpexec/gb02ad94e9c+e480a1db32/python/lsst/ctrl/mpexec/mpGraphExecutor.py", line 568, in _executeQuantaMP
raise MPGraphExecutorError(message)
lsst.ctrl.mpexec.mpGraphExecutor.MPGraphExecutorError: Task <TaskDef(pfs.drp.stella.fitFluxCal.FitFluxCalTask, label=fitFluxCal) dataId={instrument: 'PFS-F', exposure: 24, ...}> failed, exit code=1
I pushed another commit. I moved FluxCalib class to focalPlaneFunction.py. Its method fitArrays() takes a parameter fitter, and all that fitArrays() does is to call fitter(). After this commit, the Gen2 integration test passes.
Gen3 test still fails:
Is this error the one that price told me a few weeks ago?