[PIPE2D-685] Median filter to whiten an uncalibrated spectrum Created: 15/Dec/20  Updated: 29/Jan/22  Resolved: 15/Mar/21

Status: Done
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Story Priority: Normal
Reporter: Takuji Yamashita Assignee: Takuji Yamashita
Resolution: Done Votes: 0
Labels: flux-cal-vector, flux-calibration
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File medianFilter_AMBRE_s6000_g+1.0_m1.0_t02_z+1.00_a+0.40.AMBRE_Extp.fits.png     PNG File medianFilter_SDSS_spec-0380-51792-0236.png     PNG File medianFilter_SDSS_spec-2184-53534-0083.png     PNG File medianFilter_SDSS_spec-2248-53558-0345.png    
Issue Links:
Blocks
blocks PIPE2D-651 Spectral fitting of SDSS spectra for ... Open
blocks PIPE2D-647 Spectral stellar typing for flux cali... Done
Epic Link: flux calibration
Sprint: 2DDRP-2021 A
Reviewers: hassan

 Description   

We try the median filter to get a whitened spectrum before spectral fitting. We have tried the spectral whitening method using Fourier transformation in PIPE2D-648. In this ticket, we study a detailed methodology of the median filter. We use AMBRE templates and observed SDSS stellar spectra for this study. 

 



 Comments   
Comment by Takuji Yamashita [ 21/Dec/20 ]

I tried the median filter to the SDSS F-star spectra in Lee et al. 2011 and the AMBRE model templates. That works well in both samples. The broad Balmer lines and narrow other lines survive at the same time. Because the whitened spectra with the median filter look better than those with Fourier transformation, I would use the median filter as the first option.
 
The figures are the results of median filter whitening. Each panel follows one in the figures in PIPE2D-648. The width of median filter is 72 pixels, which is comparable to 100 nm at 600 nm. Before applying the median filter, the lines and outliers are masked by sigma-clipping and the pixels around H alpha (645 nm < λ < 665 nm) are also masked. The blue part (<~450 nm) is really worse due to many lines there.
 
Examples
an SDSS spectrum (Teff~7000K):

 
an AMBRE template (Teff~6000):

 
 
 
 
 

Comment by Takuji Yamashita [ 07/Jan/21 ]

Low temperature stars have many absorption lines. These can affect the result of the median filter whitening. This was pointed out in the 2D DRP telecon.
 
The whitened spectra of two low-temperature stars (Teff = 5400K and 6000K) are shown. As pointed out, there are a lot of small absorption lines and due to this, median filters are underestimating continua. In this media filtering process, I do the sigma clipping around a pre-whitened spectrum, but these small absorption lines are not clipped.
Another filter, e.g., a filter tracing the first quartile, may improve it.
 
Teff=5400K (SDSS star)

 
Teff=6000K (SDSS star)

Comment by Takuji Yamashita [ 15/Mar/21 ]

We can close this ticket because we have discussed about this in the telecon. After generating flux calibration vectors using these whitened spectra, we will revisit the whitening study to improve the accuracy. 

Generated at Sat Feb 10 15:56:29 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.