[PIPE2D-1290] Define metrics to evaluate the extraction accuracy Created: 29/Aug/23 Updated: 14/Oct/23 |
|
| Status: | Open |
| Project: | DRP 2-D Pipeline |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Task | Priority: | Normal |
| Reporter: | Satoshi Hamano | Assignee: | Unassigned |
| Resolution: | Unresolved | Votes: | 0 |
| Labels: | EDR, QualityAssurance | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Attachments: |
|
||||||||
| Issue Links: |
|
||||||||
| Description |
|
The metrics to evaluate the extraction accuracy should be defined to make a QA script. |
| Comments |
| Comment by Satoshi Hamano [ 30/Aug/23 ] |
|
Yabe-san's notebook produces the extraction residual image (calexp - image simulated from traces and pfsArm) and the residual/calexp image.
|
| Comment by Satoshi Hamano [ 30/Aug/23 ] |
|
Also, the stats (mean, median, and std dev) per 7x7 pix cell are plotted for the residual image.
|
| Comment by Satoshi Hamano [ 30/Aug/23 ] |
|
I'd like to add a function to calculate the rms of the extraction residual for each fiber and for the whole detector. |
| Comment by Satoshi Hamano [ 07/Sep/23 ] |
|
Residual/error image. np.sqrt(calexp.variance.array) is used as the error. |
| Comment by Satoshi Hamano [ 07/Sep/23 ] |
|
The chi^2 and the calexp average of each fiber are plotted. The fibers of bright objects and its adjacent fibers tend to have large chi^2. The example images of the residual/error, calexp, and mask for the fiber of the bright object is attached. The bumpy pattern is created by rearranging the distorted fiber trace into a straight line.
|
| Comment by Masayuki Tanaka [ 07/Sep/23 ] |
|
Thank you, Hamano-san! Can I make a few suggestions?
|
| Comment by Satoshi Hamano [ 08/Sep/23 ] |
|
Thank you for your comments. I updated the figures. |
| Comment by Satoshi Hamano [ 12/Sep/23 ] |
|
The data points of different targetType are plotted with different colors. |