[PIPE2D-1030] Add scripts to export products from the Gen3 datastore Created: 03/May/22 Updated: 08/Feb/23 Resolved: 05/Nov/22 |
|
| Status: | Done |
| Project: | DRP 2-D Pipeline |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Story | Priority: | Normal |
| Reporter: | price | Assignee: | price |
| Resolution: | Done | Votes: | 0 |
| Labels: | Gen3 | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Story Points: | 4 |
| Sprint: | 2DDRP-2022 F, 2DDRP-2023 A |
| Reviewers: | hassan |
| Description |
|
The Gen3 datastore stores products with different filename templates than we want to use for the data we send to the collaboration, and a couple of datasets (pfsSingle, pfsObject) are grouped. We need to add a script that will export the data from the Gen3 datastore with the correct filename templates and formats. |
| Comments |
| Comment by price [ 12/Oct/22 ] |
|
Added script, put it in the integration test, and fixed a few bugs I discovered in the process. |
| Comment by hassan [ 03/Nov/22 ] |
|
All changes look fine to me. |
| Comment by price [ 05/Nov/22 ] |
|
Merged. |