[PIPE2D-1335] Plan for data acquisition for December 2023 run Created: 28/Nov/23  Updated: 24/Jan/24  Resolved: 20/Jan/24

Status: Done
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Normal
Reporter: Kiyoto Yabe Assignee: Kiyoto Yabe
Resolution: Done Votes: 0
Labels: EngRun
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Relates
relates to PIPE2D-1303 Plan for data acquisition for October... Won't Fix
Sprint: 2DDRP-2023 A

 Description   

Please make a plan for the data acquisition in December 2023 run. This is the first case to take a complete set of calibration data for all spectrograph (except for n4).

The goal of the run

    Take calibration data as much as possible to resolve the problems and improve the pipeline. Since we have all spectrographs and cameras (except for n4), try to define a standard set of data and the way to take (and reduce) in the regular operation.

The data set we take (PRELIMINARY!!) Most of them below may be replaced by just a reference to the document of the standard data set we routinely take in future.

[Higher priority]

  • biases / darks (~20 / ~140 min.)
    • no telescope time needed
    • masterBiases (20 min.?) and masterDarks (140 min.?) but take n-band darks occasionally for removing persistence
  • data for detectorMap (~120 min.)
    • a full set of arcs and quartz (configuration in allHome)
      • brn (5 frames per arc lamp and quartz) (60 min.?)
      • bmn (5 frames per arc lamp and quartz) (80 min.?)
    • retake a few times during the run to see the stability (is this needed?)
  • data for FiberProfiles (TBD min.)
    • repeat the following sequence for [*mod4+1, mod4+2, mod4+3, mod4+4*]
      •  (darkRoach)
        • configure to allHidden (20 min.)
        • 45 sec. quartz brn for dithers of 0.0, -0.4, 0.2, 0.0, 0.2, 0.4, 0.0 pixels (TBD min.)
        • 45 sec. quartz bmn for dithers of 0.0, -0.4, 0.2, 0.0, 0.2, 0.4, 0.0 pixels (TBD min.)
      • (mod4+x)
        • configure to mod4+x (2 min?)
        • 45 sec. quartz brn for dithers of 0.0, -0.4, 0.2, 0.0, 0.2, 0.4, 0.0 pixels (TBD min.)
        • 45 sec. quartz bmn for dithers of 0.0, -0.4, 0.2, 0.0, 0.2, 0.4, 0.0 pixels (TBD min.)
    • We may add the sequence for mod32 (or mod16) with no dithering in the above
    • take n-band dark while configuring allHidden?
    • can we replace bmn --> m?**
  • data for illumination study (TBD min.)
    • take arc/quartz with/without flat screen (in allHome)
      • configure to allHome (if home keep the configuration)
      • (with flat screen)
        • remove top screen (if removed keep the screen position)
        • brn (3 frames for HgCd [TBC] and quartz) 
        • bmn (3 frames for HgCd [TBC] and quartz)
      • (without flat screen)
        • insert top screen
        • brn (3 frames for HgCd [TBC] and quartz) 
        • bmn (3 frames for HgCd [TBC] and quartz)
    • change illumination using different ring lamp position (in allHome)
      • configure to allHome (if home keep the configuration)
      • repeat the following the lamp position in [p1, p2, p3, p4]
        • Turn ring lamp p1
        • brn, 3 repeats of TBD sec. ring lamp quartz (TBD min.)
        • bmn, 3 repeats of TBD sec. ring lamp quartz (TBD min.)

[Lower priority]

  • data for background study (TBD min.)
    • take sparse sky in [*allHidden, mod32, mod16*]
      • configure to allHidden (20 min.)
      • brn, 3 repeats of TBD sec. sky (TBD min)
      • bmn, 3 repeats of TBD sec. sky (TBD min.)
      • configure to mod32 (2 min?)
      • brn, 3 repeats of TBD sec. sky (TBD min)
      • bmn, 3 repeats of TBD sec. sky (TBD min.)
      • configure to mod16 (2 min?)
      • brn, 3 repeats of TBD sec. sky (TBD min)
      • bmn, 3 repeats of TBD sec. sky (TBD min.)  
    • take arc/quartz in [*allHidden, mod32, mod16?*]
      • configure to allHidden (20 min.)
      • brn, 3 repeats of arcs and quartz (36 min)
      • bmn, 3 repeats of arcs and quartz (48 min.)
      • configure to mod32 (2 min?)
      • brn, 3 repeats of arcs and quartz (36 min)
      • bmn, 3 repeats of arcs and quartz (48 min.)
      • configure to mod16 (2 min?) <-- do we need?
      • brn, 3 repeats of arcs and quartz (36 min)
      • bmn, 3 repeats of arcs and quartz (48 min.)
    • do we need take allHidden data just before each brn(or bmn) sequence like fiberProfiles data?
  • data for dot penumbra study (TBD min.)
    • configure cobras at different distance from dots
    • take brn, 3 repeats of quartz
  • data for uniformity (~90 min.)
    • quartz (in allHome)
      • configure to allHome
      • brn, 3 repeats of 60 sec. quartz, InR = -150,-90,-30,0,30,90,150 (7 min. x 7)
    •  twilight (in allHome)
      • configure to allHome
      • brn, 3 repeats of 180 sec. twilight, InR = -90, 0, 90 (13 min. x 3)
  • data for PSF modeling (TBD min.)
    • change various theta/phi angle
      • configure cobras at different theta/phi angle
      • take brn, 3 repeats of quartz
    • (defocus data for Kota’s study if we have time)
  • data for n-band specific?

Data analysis plan

  • Generate CALIBs (a good chance for NAOJ to make CALIBs)
    • masterBiases/masterDarks --> constructPfsBias.py & constructPfsDark.py
    • detectorMap --> reduceArc
    • fiberProfiles --> reduceProfiles
    • flat --> TBC
  • QA analysis 
    • run detectorMapQA (based on Wilfred's notebook?)
    • run extractionQA (Hamano-san will prepare a script)


 Comments   
Comment by rhl [ 29/Nov/23 ]

Do we have a document that describes the calibration (and other) data that we need to routinely take? After the July experience, it's clear that we need to be more careful about taking the calibrations, and that stability cannot be assumed – while we think that the problem is the flat field screen, this isn't yet proven (e.g. Kota Hayashi's results don't yet seem to reproduce the effects we see).

So, I think we need a document (pbworks?) which describes the standard calibrations, including how to both take and reduce them. Then these "run" tickets could refer to that general description, and only add extra things that are special. An example would be that in December I think we're going to want to look at how fibres move as we change the flat field screen illumination (e.g. using one ring-lamp at a time).

Comment by yuki.moritani [ 30/Nov/23 ]

I think it is good idea. In the recent runs, we referred previous tickets, PBworks page, and obslog.. but a dedicated document should exist.. 

Comment by yuki.moritani [ 12/Dec/23 ]

I'm sorry for slow work, but I'm making the procedure here:
https://sumire.pbworks.com/w/page/155335224/Procedure%20to%20take%20test%20and%20calibration%20data%20during%20engineering%20run

And here are a few comments:

I'd suggest to take

  • Quartz (and arc) at least every night to trace stability
  • (If there is a chance and we can prepare)
    • Some data to to study dot penumbra
    • Quartz at different Cobra phi/theta position

Also, we need to make new maskFiles for mod32/mod16 with all SMs if you need ones. Arnaud has updated the mask for fibrProfile, but not for the other items (INSTRM-2123). 

Comment by price [ 12/Dec/23 ]

For the fiberProfiles, thank you for including the dithers on the dot-roach darks. Could I further request that the dot-roach darks be taken immediately before (or after) the observations they are intended to correct? I understand that this may require an additional fiber move, but I think it's worth it to reduce the possibility of the quartz brightness changing.

For the background study, could you also please observe each lamp separately in the mod32 configuration? Data was previously obtained with something like a mod10 configuration, but I think the extra spacing could be helpful.

I second Moritani-san's request for quartzes at different cobra positions; I think this will be important to see how good the extraction is when the fibers aren't at the home position. If you have lots of spare time, maybe we could do a complete fiberProfile run (the four sets of mod4 observations) with the exposed fibers at a position that isn't "home", but a position calculated/suspected to have the worst effect on the fiber profile (without going into the black spot penumbra; maybe this is just 180 degrees from the home position?).

Comment by yuki.moritani [ 13/Dec/23 ]

If "dot-roach" dark means quartz taken after dot-roaching, with all fiber hidden (step 5–7 in the PBworks page), maybe we could take some if we take data one group after another?

Previous data were taken during exposure for the PSF modeling... is only mod32 enough?

Comment by price [ 13/Dec/23 ]

Yes, a "dot-roach dark" is a quartz exposure with all fibers hidden. The current plan is:

  • dot-roach dark brn, dithered (but I don't see dithering mentioned on the PBWorks page)
  • dot-roach dark bmn, dithered (but I don't see dithering mentioned on the PBWorks page)
  • mod4 traces bmn, dithered
  • mod4 traces brn, dithered
    In this case, the brn traces are taken long after the brn dot-roach dark. I would like to minimise the time between taking the "dot-roach dark" and the corresponding exposures with fibers revealed. An example ordering might be:
  • dot-roach dark brn, dithered (but I don't see dithering mentioned on the PBWorks page)
  • mod4 traces brn, dithered
  • dot-roach dark bmn, dithered (but I don't see dithering mentioned on the PBWorks page)
  • mod4 traces bmn, dithered
    As I said, this probably means an extra fiber move.
Comment by yuki.moritani [ 13/Dec/23 ]

OK, you are requesting to add dithered trace with all fiber hidden behind dot. 

Just out of curiosity... in July the groups 2,4,4 were taken on after another.. and did you see some instability in allHidden traces? (It was not dithered thought..)

If on-telescope time is approved, we should have enough time in this period,, so problably we can separate brn / bmn. We (Arnaud) used this procedure to save time to dot-roaching.

Comment by price [ 13/Dec/23 ]

I didn't see instability in the quartz fluxes, but I want to be even more sure that it's not lurking.

Comment by price [ 13/Dec/23 ]

Oh, even more important than the quartz fluxes is the possibility of the fibers moving on the detector due to normal flexure in the instrument over time.

We've seen shifts in the July 2023 run (compare dot-roach dark 97774 and quartz 97805 for fiberId=41 on r1). This might be due to the slit not returning to the correct location or optical changes over time, but we can relatively cheaply suppress the latter by taking the dot-roach dark immediately before or after the quartzes they are intended to correct, with no intervening exposures. (I don't think there's a cheap way to suppress the former.)

Comment by price [ 13/Dec/23 ]

Cobras that fail to reach their destination may be acceptable for science exposures, but for calibs it means we’re going to get sub-optimal measurements for that fiber that will affect it (and potentially neighboring fibers) for the entire run or even longer. I think that means it’s generally worth spending extra time allowing the cobras to converge for calibs.

Comment by cloomis [ 19/Dec/23 ]

Do we need/want to check hexapod repeatability when doing the dithers? I.e do we want to run [ 0.0, -0.4, -0.2, 0.0, 0.2, 0.4, 0.0 ]?

Comment by yuki.moritani [ 19/Dec/23 ]

The default sequence is like that. More precisely, (home, -0.4, -0.2, 0.0, 0.2, 0.4, home, and home=0) and if the slit is power off, take 1 frame with power off (so we should slit on before profile) at the beginning and at the end.

Comment by yuki.moritani [ 19/Dec/23 ]

Regarding to take arc/trace to check illumination pattern with and without flat screen, could you confirm which lamp to be used? PFIlamp to compare the July.. is my understanding correct?

Comment by yuki.moritani [ 20/Dec/23 ]

Regarding to sparse-sky, Jim told that the dark-sky is most important (and moony sky). so exposure time should be longer to obtain enough count (around half of full fell or less in IR).

Comment by Kiyoto Yabe [ 20/Jan/24 ]

The run has been finished so I close this.

Generated at Sat Feb 10 16:06:15 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.