[INSTRM-1850] DrpActor nir images processing is slow Created: 02/Feb/23  Updated: 07/Feb/23  Resolved: 07/Feb/23

Status: Done
Project: Instrument control development
Component/s: ics_drpActor
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Normal
Reporter: fmadec Assignee: arnaud.lefur
Resolution: Done Votes: 0
Labels: SPS
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   

DrpActor handles the ingest and the IPCTask for Nir images. IPCTask takes 2 minutes so it takes a long time to complete process for a bunch of sequences

on way to solve that on short term (discussed during today DRP/ICS telecon) could be to

  • separate ingest and "detrend"
  • add a command to deactivate the detrend processing and keep only ingest

 Comments   
Comment by arnaud.lefur [ 07/Feb/23 ]

so I did separate ingest and detrend.
ingest happens in the main thread, whereas detrend is happening is own process.
I'm using ProcessPoolExecutor(4), meaning that up to 4 images can be processed at the same time, first in first out.

tagged as 0.3.7

Generated at Sat Feb 10 16:40:16 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.