[SURVEY-8] Simulating a spectrum with a more realistic assumption of sky subtraction error Created: 28/Dec/18  Updated: 11/Jun/19

Status: Open
Project: Survey operation on planning and tracking
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major
Reporter: naoyuki.tamura Assignee: Kiyoto Yabe
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PDF File survey-8_new_mode2_comparison.pdf     PDF File survey-8_new_mode_comparison.pdf    
Issue Links:
Relates
relates to SURVEY-17 Implement wavelength variation in the... Open
relates to SURVEY-18 Implement PSF profile variation in th... Open
relates to SURVEY-19 Implement sky variation across the Fo... Open

 Description   

The Chris Hirata's simulator (i.e. current ETC) allows a user to choose "sky subtraction error" as a parameter. But this accordingly adds a random error per detector pixel on top of simulated spectrum. Meanwhile, in the reality, sky subtraction error appears as a residual of sky spectrum and the amplitude of the residual varies from exposure to exposure depending on how wrongly the data are processed e.g. in the spectral calibration. 

To estimate the expected quality of a spectrum at a given integration time, it is crucial to simulate a spectrum in such a way as reasonably consistent with the reality. The key uncertainty in doing this is the amplitude of the sky residual at a given exposure, but perhaps a starting point is to assume that it randomly varies from exposure to exposure with a variance equal to a certain percentage (e.g. 0.5%, 1.0%) of sky.

Possible modes of sky subtraction residual are:

  • systematic residual with random scale (probably due to fiber throughput variation)
  • wavelength shift (due to the wavelength calibration uncertainty, which is expected to be very small)
  • variation of PSF profile (tested with arc data)
  • spatial variation of sky (see Murdoch thesis)
  • variation of dichroic throughput (at transition wavelength)

 



 Comments   
Comment by Kiyoto Yabe [ 25/Jan/19 ]

Here is an interim report:

What is done:

  • A new mode for adding sky subtraction error is now under testing
  • Assuming 1200 sec. x 6 exposures, which is expected for main sample of the Galaxy/AGN evolution survey
  • In each exposure, a certain fraction of sky spectrum is added as sky systematic residual
  • The fraction is randomized by following a Gaussian distribution with its standard deviation of 1%
  • Other random noise is also added in the spectrum
  • The final stacked spectrum is made by averaging these spectra

Below is an example of the resulting spectra with previous mode and the new mode:

survey-8_new_mode_comparison.pdf

(Top left) previous mode adding 1% sky subtraction error as a random noise. (Top right) new mode randomly adding sky subtraction residual in each exposure with the standard deviation of 1%. This is a good case that compensate residuals and overshooting. (Bottom left) The same as top right but there is much residual in the final spectrum. (Bottom right) The same as top right but there is much negative feature because the sky is over subtracted.

Generated at Sat Feb 10 16:52:03 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.