[PIPE2D-1060] Tune hyperparameters of fluxmodel interpolation Created: 13/Jul/22 Updated: 05/Jun/23 Resolved: 17/Aug/22 |
|
Status: | Done |
Project: | DRP 2-D Pipeline |
Component/s: | None |
Affects Version/s: | None |
Fix Version/s: | None |
Type: | Task | Priority: | Normal |
Reporter: | sogo.mineo | Assignee: | sogo.mineo |
Resolution: | Done | Votes: | 0 |
Labels: | flux-calibration | ||
Remaining Estimate: | Not Specified | ||
Time Spent: | Not Specified | ||
Original Estimate: | Not Specified |
Attachments: |
![]() ![]() ![]() ![]() ![]() ![]() |
||||||||
Issue Links: |
|
||||||||
Reviewers: | hassan |
Description |
In The hyperparameters are, however, not optimal. For low temperature and low log(g), I know that the max relative error max_{λ} |(rbf(λ) - f(λ)) / f(λ)| is sometimes above 100%, where f(λ) is an AMBRE spectrum at (Teff, log(g), metal, alpha), and rbf(λ) is the RBF interpolation at (Teff, log(g), metal, alpha) guessed from all the other combinations of parameters than (Teff, log(g), metal, alpha). I must tune the hyperparameters more carefully. The smaller the scale parameters are, the better the RBF interpolation is. As the scale parameters get smaller, however, the condition number of the matrix of the linear equations to be solved gets worse (wikipedia says). In searching for the best scale parameters, I set the initial guess to somewhat big value, assuming that the condition number was small there, and hoping that the optimizer would optimize the parameters gradually to a smaller values as long as the linear equations were soluble. The optimization program has been running for a week, and it now seems to have found the minimum. The optimized problem was as follows: Minimize The new fluxmodeldata package, when made, will be compatible to the previous one ( Edit: Uploaded the new version of fluxmodeldata here: https://hscdata.mtk.nao.ac.jp/hsc_bin_dist/pfs/fluxmodeldata-ambre-20220714-full.tar.xz |
Comments |
Comment by sogo.mineo [ 14/Jul/22 ] |
|
Comment by sogo.mineo [ 14/Jul/22 ] |
|
Comment by sogo.mineo [ 14/Jul/22 ] |
|
Comment by sogo.mineo [ 14/Jul/22 ] |
|
Comment by sogo.mineo [ 15/Jul/22 ] |
I confirmed that drp_stella's unit tests passes with the new fluxmodeldata package. |
Comment by sogo.mineo [ 15/Jul/22 ] |
Could you review this task? The product of this task has been uploaded to the URL shown at the bottom of the description. There are no changes to programs. Only the full fluxmodeldata package ( |
Comment by hassan [ 11/Aug/22 ] |
I think this is fine. Would it be possible to test the situation where the absorption at ~393.5 nm is masked out during the interpolation process? |
Comment by sogo.mineo [ 16/Aug/22 ] |
I started the computation just now. It will end in a day. |
Comment by sogo.mineo [ 17/Aug/22 ] |
> the absorption at ~393.5 nm is masked out during the interpolation process |
Comment by sogo.mineo [ 17/Aug/22 ] |
I am closing this issue. Thank you for reviewing. |