[PIPE1D-17] The latest drp_1d, drp_1dpipe produce error messages when they run with an input pfsObject***.fits from the latest ETC. Created: 09/Jul/20  Updated: 22/Jul/20  Resolved: 22/Jul/20

Status: Done
Project: DRP 1D pipeline
Component/s: drp_1d, drp_1dpipe
Affects Version/s: None
Fix Version/s: None

Type: Story Priority: Normal
Reporter: ishigaki Assignee: Pierre-Yves CHABAUD
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: File pfsObject-000-00000-0,0-0000000000000001-001-0x8cf7641568bdb4ab.fits    

 Description   

drp_1d(0.10.0_rc1) and drp_1dpipe (0.14.0_rc2) run successfully and produce a pfsZcandidates**.fits when an input pfsObject**.fits from "datapack_0.14.0_rc2" is used.

On the other hand, when an input pfsObject**.fits from the ETC (tickets/SURVEY-24 branch) is used, the following error messages are shown at the end and a pfsZcandidates**.fits is not produced (other output files or directories seem to have been produced).  The input file is attached.

 

---- from here ----

Saving 2 redshifts to /data22b/work/ishigaki/lam-1d/examples/GAtest/drp1d_spectra_20200706T171229Z/B0/data/pfsZcandidates-000-00000-0,0-0000000000000001-001-0x8cf7641568bdb4ab.fits
Traceback (most recent call last):
 File “/data22b/work/ishigaki/bin/process_spectra”, line 11, in <module>
  load_entry_point(‘drp-1dpipe==0.14.0rc2’, ‘console_scripts’, ‘process_spectra’)()
 File “/home/ishigaki/.local/lib/python3.6/site-packages/drp_1dpipe/process_spectra/process_spectra.py”, line 366, in main
  return main_method(config)
 File “/home/ishigaki/.local/lib/python3.6/site-packages/drp_1dpipe/process_spectra/process_spectra.py”, line 340, in main_method
  amazed(config)
 File “/home/ishigaki/.local/lib/python3.6/site-packages/drp_1dpipe/process_spectra/process_spectra.py”, line 280, in amazed
  products.append(result.write(data_dir))
 File “/home/ishigaki/.local/lib/python3.6/site-packages/drp_1dpipe/process_spectra/results.py”, line 377, in write
  object_class)
 File “/home/ishigaki/.local/lib/python3.6/site-packages/drp_1dpipe/io/writer.py”, line 46, in write_candidates
  zcandidates[i][‘MODELFLUX’] = np.array(models[i])
ValueError: could not broadcast input array from shape (11000) into shape (11376)

 



 Comments   
Comment by Pierre-Yves CHABAUD [ 22/Jul/20 ]

A spectrum model is created on reliable pixels (pixels with mask =0 in pfsObject). The number of reliable pixels is shorter than whole number of pixels (in this case 11000 reliable pixels and 11373 total pixels). This issue is fixed by affecting NaN values to model related to unreliable pixels.

Generated at Wed Apr 09 19:58:54 JST 2025 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.