[INSTRM-1709] Update drpActor to use the latest CALIB Created: 21/Sep/22  Updated: 30/Nov/22  Resolved: 30/Nov/22

Status: Done
Project: Instrument control development
Component/s: pfs_obslog
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Normal
Reporter: hassan Assignee: hassan
Resolution: Done Votes: 0
Labels: EngRun
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Story Points: 4
Sprint: preEngRun08Nov

 Description   

As discussed in the obslog slack channel, obslog processes raw data reads processed data at the summit from rerun /data/drp/sm1-5.2/rerun/ginga/drpActor/ that requires an old CALIB, CALIB-PFI-20211108. The CALIB is likely to be updated frequently before engineering runs and other commissioning activities. Please arrange for support for newer calibs, and for the processing to use the latest CALIB. The latest CALIB at the time of writing is CALIB-20220630.

This might mean coordinating a switch to a new CALIB, and start a whole new rerun (this would mean multiple historical reruns, the pros and cons of that need to be considered).

This is not a priority for the September 2022 Engineering Run, as the processing that is done with obslog (detrend) can work fine with CALIB-PFI-20211108.



 Comments   
Comment by cloomis [ 21/Sep/22 ]

Is it really obslog which runs detrend, etc? I would have thought that drpActor ingests and detrends, and that obslog just reads the files on disk? arnaud.lefur?

Comment by arnaud.lefur [ 21/Sep/22 ]

Yes, obslog just lookup for existing files in a given folder, I believe it's not even using the butler.

Comment by arnaud.lefur [ 21/Sep/22 ]

As I mentioned somewhere on slack, the post-isr images takes actually quite a lot space :

(conda-ics) alefur@shell-ics:/data/drp/sm1-5.2/rerun$ du -sch ginga/
9.8T    ginga/                                                                            
9.8T    total 

so, I think we need to take that into account if we were to reprocess 2.5 years of data.

Comment by arnaud.lefur [ 30/Nov/22 ]

drpActor both summit and hilo use now the latest calib.

Generated at Sat Feb 10 16:38:34 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.