[PIPE2D-1198] Scary warnings from mergeArms.py Created: 01/Apr/23  Updated: 04/Jul/23

Status: Open
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Story Priority: Minor
Reporter: rhl Assignee: price
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   

Running mergeArms.py generates scary warnings, some of which look like real bugs. E.g. on tiger

mergeArms.py /projects/HSC/PFS/Subaru --calib /projects/HSC/PFS/Subaru/CALIB-price-20230327 --rerun rhl/edr/20230327 --id visit=82120^82127 arm=b^r spectrograph=1^3 -j 20
mergeArms WARN: Set of fiberIds of LSFs != fiberIds for spectra:  Only in fiberId: {1, 515, 229, 137, 426, 651, 45, 336, 273, 560, 316, 471, 184, 92, 382, 607} (fixing)

(what does this mean? What are these fibres, and why do they exist in only one list? If this is expected, why is this a WARN?)

/projects/HSC/PFS/stack/20220525/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-3.0.0/lib/python3.8/site-packages/astropy/io/fits/column.py:649: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray.
  array = np.array(array)
/projects/HSC/PFS/stack/20220525/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-3.0.0/lib/python3.8/site-packages/astropy/io/fits/column.py:649: VisibleDeprecationWarning: Creating an ndarray from ragged nested sequences (which is a list-or-tuple of lists-or-tuples-or ndarrays with different lengths or shapes) is deprecated. If you meant to do this, you must specify 'dtype=object' when creating the ndarray.
  array = np.array(array)


 Comments   
Comment by arnaud.lefur [ 01/Apr/23 ]

It looks like those fibers are engineering fibers for sm1

pfsConfig = pfsConfig[pfsConfig.spectrograph==1]
pfsConfig.fiberId[pfsConfig.targetType==TargetType.ENGINEERING]

array([  1,  45,  92, 137, 184, 229, 273, 316, 336, 382, 426, 471, 515,
       560, 607, 651], dtype=int32)

Generated at Sat Feb 10 16:04:11 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.