[PIPE2D-1225] Fix weekly breakage 2023-05-21 Created: 23/May/23  Updated: 23/May/23  Resolved: 23/May/23

Status: Done
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Story Priority: Normal
Reporter: price Assignee: price
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Reviewers: rhl

 Description   

While running reduceExposure.py:

Traceback (most recent call last):
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-3.0.0/lib/python3.8/multiprocessing/pool.py", line 125, in worker
   result = (True, func(*args, **kwds))
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-3.0.0/lib/python3.8/multiprocessing/pool.py", line 48, in mapstar
   return list(map(*args))
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/cmdLineTask.py", line 433, in __call__
   result = self.runTask(task, dataRef, kwargs)
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/pipe_base/g590c34a36e+5da9528084/python/lsst/pipe/base/cmdLineTask.py", line 504, in runTask
   return task.runDataRef(dataRef, **kwargs)
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/drp_stella/w.2023.21/python/pfs/drp/stella/reduceExposure.py", line 353, in runDataRef
   self.write(sensorRefList, results)
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/drp_stella/w.2023.21/python/pfs/drp/stella/reduceExposure.py", line 414, in write
   sensorRef.put(lines, "arcLines")
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/butlerSubset.py", line 221, in put
   self.butlerSubset.butler.put(obj, datasetType, self.dataId, doBackup=doBackup, **rest)
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/butler.py", line 1455, in put
   location.getRepository().write(location, obj)
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/repository.py", line 182, in write
   return butlerLocationStorage.write(butlerLocation, obj)
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/posixStorage.py", line 257, in write
   writeFormatter(butlerLocation, obj)
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/daf_persistence/g6a31054a6e+4ae6138134/python/lsst/daf/persistence/posixStorage.py", line 828, in writeFitsCatalogStorage
   obj.writeFits(logLoc.locString(), **kwds)
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/drp_stella/w.2023.21/python/pfs/drp/stella/table.py", line 242, in writeFits
   self.toPfsTable().writeFits(filename)
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/datamodel/w.2023.21/python/pfs/datamodel/pfsTable.py", line 333, in writeFits
   self.writeHdu(fits)
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/datamodel/w.2023.21/python/pfs/datamodel/pfsTable.py", line 298, in writeHdu
   columns = [
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/stack/miniconda3-py38_4.9.2-3.0.0/Linux64/datamodel/w.2023.21/python/pfs/datamodel/pfsTable.py", line 299, in <listcomp>
   astropy.io.fits.Column(
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-3.0.0/lib/python3.8/site-packages/astropy/io/fits/column.py", line 726, in __init__
   array = self._convert_to_valid_data_type(array)
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-3.0.0/lib/python3.8/site-packages/astropy/io/fits/column.py", line 1413, in _convert_to_valid_data_type
   return _convert_array(array, np.dtype(format.recformat))
 File "/scratch/pprice/jenkins/weekly/2023-05-21/build/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-3.0.0/lib/python3.8/site-packages/astropy/io/fits/util.py", line 722, in _convert_array
   return array.astype(dtype)
UnicodeEncodeError: 'ascii' codec can't encode character '\u2206' in position 3: ordinal not in range(128)


 Comments   
Comment by price [ 23/May/23 ]

This was caused by non-ASCII characters in the skyLines linelist.

Comment by price [ 23/May/23 ]

Revised linelist allows the weekly to pass.

Merged to master.

Generated at Sat Feb 10 16:04:28 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.