[PIPE2D-374] Combine P_HSC and P_PFS and construct the best-fit spectrum Created: 20/Feb/19  Updated: 07/Jul/21  Resolved: 06/Jul/21

Status: Done
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Normal
Reporter: hassan Assignee: Takuji Yamashita
Resolution: Done Votes: 0
Labels: flux-calibration, model-spectra-fitting
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File BBP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r13.0.txt.expt450s.Cont.png     PNG File BBP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r19.0.txt.expt450s.Cont.png     PNG File CombinedP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r13.0.txt.expt450s.Cont.png     PNG File CombinedP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r13.0.txt.expt450s.Cont.png     PNG File CombinedP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r13.0.txt.expt450s.Spec.png     PNG File CombinedP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r13.0.txt.expt450s.Spec.png     PNG File CombinedP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r13.0.txt.expt450s.SpecRatio.png     PNG File CombinedP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r19.0.txt.expt450s.Cont.png     PNG File CombinedP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r19.0.txt.expt450s.Spec.png     PNG File CombinedP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r19.0.txt.expt450s.SpecRatio.png     PNG File mad_rmag.png     PNG File mad_rmag_wlimit.png     PNG File mad_rmag_wlimit_wcolor.png     PNG File SFP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r13.0.txt.expt450s.Cont.png     PNG File SFP_p7000_g+4.5_m0.0_t01_z+0.00_a+0.00.AMBRE_Extp.ABmag_r19.0.txt.expt450s.Cont.png    
Issue Links:
Blocks
is blocked by PIPE2D-837 Regrid stellar parameters for combine... Done
is blocked by PIPE2D-367 Derive P(Teff, log g, Z) from model t... Open
Story Points: 3
Reviewers: hassan

 Description   

Following PIPE2D-367, write code to combine the P_HSC(Teff, log g, Z) and P_PFS(Teff, log g, Z) probabilities in order to construct the best fit spectrum.



 Comments   
Comment by Takuji Yamashita [ 07/Jun/21 ]

I combined two probability distribution functions from broad-band fitting (PIPE2D-539) and chi-square fitting of spectra (PIPE2D-835) to find the best fit model template of a flux standard. The combination of two PDFs is a one-to-one merge.
 
The following figures are the results of the simulated spectra with ETC and the HSC 5-bands photometry with S/N=100. The input stellar parameters of the ETC simulation are Teff = 7000 K, log(g/(cm/s^2)) = 4.5, Z = 0, and [a/Fe] = 0.0.
 
A combined PDF of an r = 13 AB mag case, the PDF of the broad-band fitting, and the spectral fitting, from the top, respectively.


 

The input spectrum (ETC) and the best-fit spectrum. 

 
A ratio of the best-fit spectrum to the input. There is a large deviation at a short wavelength of < 430 nm. This could be from small differences of Teff and log(g).

Comment by Takuji Yamashita [ 07/Jun/21 ]

These figures are the case of r = 19 mag.
The simulated spectrum is noisier, and therefore the constraint from spectral fitting is weak. As a result, the combined PDF is dominated by the broad-band fitting.

A combined PDF.

Broad-band fitting PDF.

Spectral fitting PDF.

The best-fit spectrum and the input spectrum.

The flux ratio of the best-fit to the input.

Comment by Takuji Yamashita [ 07/Jun/21 ]

This is the fitting accuracy as a function of the magnitude. The y-axis is the median absolute deviation of the flux ratio of the best-fit to the input.

Comment by Takuji Yamashita [ 21/Jun/21 ]

The measured dispersions in the flux ratio of the best-fit spectrum to the simulation spectrum are dominated by the noise in the simulation spectra. I add the dispersion only from the noise in a spectrum in the above figure (open red circles). The measured dispersions are close to the noise dispersions.

Comment by Takuji Yamashita [ 21/Jun/21 ]

In the three arms, the blue arm has an offset from the noise dispersions. This is due to a mismatch of the best-fit model to the simulation in the blue arm. We should improve this. 

 
The flux ratios of the best-fit and the simulation are small compared with the noise in the spectra in this test case. We should check other cases to see the fitting goodness.

Comment by Takuji Yamashita [ 06/Jul/21 ]

The above test shows that the fitting accuracy is about 10% for 19 magnitude stars. Although this is higher than the 1% accuracy we are aiming at, we think we can improve it by the following approaches. 

1. Because we will have several tens of standard stars in an FoV, we can statistically reduce the accuracy by combining all the standards. 

2. The dispersion of the flux ratio is dominated by the noise in the simulated spectrum. Because we expect that a flux calibration vector is smooth along the wavelength, we can fit it with a function and reduce the dispersions. 

These works to improve the fitting accuracy will be addressed during the implementation phase. 

Comment by price [ 06/Jul/21 ]

You can't assume that the flux calibration vector is completely smooth in wavelength: it should include the atmospheric absorption bands.

Comment by Takuji Yamashita [ 07/Jul/21 ]

Yes. Please let me make a few corrections and add some words. The flux calibration vector includes both a smooth component and a non-smooth one.

Although this idea needs further investigation and discussion, for example, we will fit the smooth component in the flux calibration vector with a function after masking the atmospheric absorption bands to separate the smooth component from the vector. We will use the averaged flux calibration vector with a high S/N over an FoV for this. The non-smooth component made up of the atmospheric absorption bands will be reproduced using a template or a model. By combining the fitted smooth component and the reproduced non-smooth one, we will get a more accurate flux calibration vector.

Generated at Sat Feb 10 15:52:26 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.