[PIPE2D-969] Allow ingesting PFSD (guider) files Created: 26/Jan/22  Updated: 17/Feb/22  Resolved: 17/Feb/22

Status: Done
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Normal
Reporter: cloomis Assignee: price
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Blocks
blocks INSTRM-1469 Create a Detector model for the AG CCDs Done
Relates
relates to DAMD-2 AG image output to archive In Progress
relates to INSTRM-1458 Implement the DAMD-2 PFSD files. In Progress
relates to INSTRM-1509 Add PFSD links to existing 2021-11@Su... Done
Story Points: 1
Sprint: 2DDRP-2022 B
Reviewers: hassan

 Description   

We need to ingest PFSD files, for the sake of butler access. These are different from PFSA files in two obvious ways:

  • There are six guide cameras, and each PFSD file will contain N*6 HDUs, for N exposures taken with all six cameras. We will want butler access to the Nth set of images, etc.
  • The filenames PFSDvvvvvvss.fits do have a 6-digit visit (matching the running SPS/PFS visit), but instead of an SM and an arm for the last two digits there is a two-digit "batch number" within the visit. The batch number is, unfortunately, indirect: it will increment from 00..99, but within each PFSD file there can be 1..N actual exposures. We currently envision N <= 5 (umm, 5 * 100 5s exposures will let us directly link the guide images for a ~40min visit).

 Comments   
Comment by rhl [ 27/Jan/22 ]

I think for now that we just need a template that includes the ability to specify an hdu, and push the agony into the user code. I think that Tim made this harder for gen3, but we can face that later

Comment by price [ 15/Feb/22 ]

I need some examples to test with, please.
I found some in /projects/HSC/PFS/Subaru/raw/2021-11-18/agcc.

Comment by price [ 16/Feb/22 ]

Following:

(lsst-scipipe) pprice@tiger2-sumire:/scratch/pprice/pipe2d-969 $ echo lsst.obs.pfs.PfsMapper > _mapper
(lsst-scipipe) pprice@tiger2-sumire:/scratch/pprice/pipe2d-969 $ ingestPfsImages.py /scratch/pprice/pipe2d-969/ /projects/HSC/PFS/Subaru/raw/2021-11-18/agcc/PFSD*.fits

we can now:

from lsst.daf.persistence import Butler
butler = Butler(".")
exposure = butler.get("guider", visit=70901, sequence=0, hdu=1)
Comment by hassan [ 17/Feb/22 ]

Changes look fine.

Comment by price [ 17/Feb/22 ]

Merged.

Generated at Sat Feb 10 16:00:37 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.