Uploaded image for project: 'DRP 1D pipeline'
  1. DRP 1D pipeline
  2. PIPE1D-17

The latest drp_1d, drp_1dpipe produce error messages when they run with an input pfsObject***.fits from the latest ETC.

    Details

      Description

      drp_1d(0.10.0_rc1) and drp_1dpipe (0.14.0_rc2) run successfully and produce a pfsZcandidates**.fits when an input pfsObject**.fits from "datapack_0.14.0_rc2" is used.

      On the other hand, when an input pfsObject**.fits from the ETC (tickets/SURVEY-24 branch) is used, the following error messages are shown at the end and a pfsZcandidates**.fits is not produced (other output files or directories seem to have been produced).  The input file is attached.

       

      ---- from here ----

      Saving 2 redshifts to /data22b/work/ishigaki/lam-1d/examples/GAtest/drp1d_spectra_20200706T171229Z/B0/data/pfsZcandidates-000-00000-0,0-0000000000000001-001-0x8cf7641568bdb4ab.fits
      Traceback (most recent call last):
       File “/data22b/work/ishigaki/bin/process_spectra”, line 11, in <module>
        load_entry_point(‘drp-1dpipe==0.14.0rc2’, ‘console_scripts’, ‘process_spectra’)()
       File “/home/ishigaki/.local/lib/python3.6/site-packages/drp_1dpipe/process_spectra/process_spectra.py”, line 366, in main
        return main_method(config)
       File “/home/ishigaki/.local/lib/python3.6/site-packages/drp_1dpipe/process_spectra/process_spectra.py”, line 340, in main_method
        amazed(config)
       File “/home/ishigaki/.local/lib/python3.6/site-packages/drp_1dpipe/process_spectra/process_spectra.py”, line 280, in amazed
        products.append(result.write(data_dir))
       File “/home/ishigaki/.local/lib/python3.6/site-packages/drp_1dpipe/process_spectra/results.py”, line 377, in write
        object_class)
       File “/home/ishigaki/.local/lib/python3.6/site-packages/drp_1dpipe/io/writer.py”, line 46, in write_candidates
        zcandidates[i][‘MODELFLUX’] = np.array(models[i])
      ValueError: could not broadcast input array from shape (11000) into shape (11376)

       

        Attachments

          Activity

          Hide
          pychabau Pierre-Yves CHABAUD added a comment -

          A spectrum model is created on reliable pixels (pixels with mask =0 in pfsObject). The number of reliable pixels is shorter than whole number of pixels (in this case 11000 reliable pixels and 11373 total pixels). This issue is fixed by affecting NaN values to model related to unreliable pixels.

          Show
          pychabau Pierre-Yves CHABAUD added a comment - A spectrum model is created on reliable pixels (pixels with mask =0 in pfsObject). The number of reliable pixels is shorter than whole number of pixels (in this case 11000 reliable pixels and 11373 total pixels). This issue is fixed by affecting NaN values to model related to unreliable pixels.

            People

            • Assignee:
              pychabau Pierre-Yves CHABAUD
              Reporter:
              ishigaki ishigaki
            • Votes:
              0 Vote for this issue
              Watchers:
              Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: