[PIPE2D-644] Create NIR simulated data and run the end-to-end test including NIR data Created: 14/Oct/20  Updated: 15/Feb/21  Resolved: 15/Feb/21

Status: Done
Project: DRP 2-D Pipeline
Component/s: dev_pipe_e2e
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Normal
Reporter: Kiyoto Yabe Assignee: Kiyoto Yabe
Resolution: Done Votes: 0
Labels: DRP_end-to-end_processing
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File pipe2d-644_example_0x12.png    
Issue Links:
Blocks
blocks PIPE2D-608 Confirm that 2D-DRP products can be p... Done
blocks PIPE2D-646 Regular end-to-end DRP processing tes... In Progress
blocks PIPE2D-606 Run test scripts for the end-to-end p... Done
is blocked by PIPE2D-641 Optimise fitGlobalDetectorMap on full... Done
is blocked by PIPE2D-691 Fix sky subtraction for pfsObject Done
Relates
relates to SIM2D-127 Run 2D simulator for the end-to-end p... Done
Sprint: 2DDRP-2021 A, 2DDRP-2021 A 2

 Description   

Currently, pfs_pipe2d integration test uses only r and b arm data. To do complete end-to-end test including NIR data, run SIM2D to generate NIR data (assuming fake detector) and run the end-to-end test with 2D and 1D pipelines.

 Comments   
Comment by price [ 14/Oct/20 ]

The weekly integration test contains n (and m) data that might be suitable.

Comment by Kiyoto Yabe [ 15/Oct/20 ]

Thank you! I'm trying both.

Comment by Kiyoto Yabe [ 15/Oct/20 ]

Processing for weekly test dataset is still running, probably because of a large number of objects. On the other hand, regenerating simulated image (including NIR) for integration test dataset and processing test have been finished. It looks that both pipelines work well as shown in the figure below.

 

Comment by price [ 15/Oct/20 ]

Oh, I forgot: I disabled the weekly because processing takes forever with the master version (PIPE2D-641). I am actively working on fixing this, but in the mean time you could roll back to before PIPE2D-358 merged (e.g., w.2020.38 tag).

Comment by Kiyoto Yabe [ 16/Oct/20 ]

OK, understood, thank you.

Generated at Sat Feb 10 15:55:46 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.