[INSTRM-1392] Determine blackspot positions on PFI at different elevation angles Created: 12/Oct/21  Updated: 02/Aug/23

Status: In Progress
Project: Instrument control development
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Normal
Reporter: hassan Assignee: yuki.moritani
Resolution: Unresolved Votes: 0
Labels: EngRun
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PNG File dot_meas_example_20210926.png     PNG File dot_meas_example_20210926.png     PNG File quickComparison_dotPosition_20221130.png    
Issue Links:
Blocks
blocks INSTRM-1388 Poor convergence quality during Sep 2... Done
Relates
relates to PIPE2D-1018 Plan for data acquisition May 2022 run Done
Story Points: 2
Sprint: PreEngRun4, EngRun3Cleanup

 Description   

Determine the blackspot positions in the PFI coordinate system, in units of mm, as a function of elevation angle.

Comment by RHL:

How is this to be carried out? Using the 71M (and if so, I think we need to include the effects of parallax. I don't know how Kiyoto determined his spot positions, but even if we validate and use his code we need the result in mm)



 Comments   
Comment by yuki.moritani [ 16/Oct/21 ]

Just in case... The images were already taken using during Sep run (with focal plane illuminated by the dome room lights). 

Comment by rhl [ 28/Oct/21 ]

What is the plan for making progress on this one?  Can Kiyoto Yabe provide some details on how he processed the 71M data, and can we provide a file with the known design or as-built positions?

When I was in Hilo in September I was confused by as-designed black spot files. chyan gave me data/pfi/dot/dot_design_asrd_20210422.txt which I couldn't make line up, and then yuki.moritani gave me another file which made more sense.  Do we have a file that we can commit to git and which we believe to be correct?  Either as-built or design, but definitely in PFI mm.  I should remake the plots that backup my claims in this paragraph!

Comment by Kiyoto Yabe [ 28/Oct/21 ]

(I thought I had already done somewhere before but) I have shared my notebooks to measure the dot position at Subaru here:

https://github.com/Subaru-PFS/pfs_utils/tree/u/kiyoyabe/dot_measurements_subaru_202107/notebooks/kiyoyabe

I was just starting from designed dot position in mm (dot_pos_final.txt, which is exactly the same as dot_design_asrd_20210422.txt I believe), but this was just to make an initial guess of the position in pix on 71M. So, I think that the transformation in the beginning of the notebook is meaningless.

Then I search the dot in disk shape around the initial guess, but the measurement is not good in some dots, so by using the measured data points, I calculate the transformation (including camera distortion) between designed dots (in mm) to dots on 71M (in pix).

Then I did the second run and refine the transformation and get the final dot positions (in pix) and write down to the csv file (I did for multiple visits and averaged in deed):

https://github.com/Subaru-PFS/pfs_instdata/blob/master/data/pfi/dot/dot_measurements_subaru_20210710_el90_rot%2B00_ave.csv

Just for your reference, the measured values are reasonable matched to the images all over the field like this:

https://github.com/Subaru-PFS/pfs_utils/blob/u/kiyoyabe/dot_measurements_subaru_202107/notebooks/kiyoyabe/dot_meas_example1.png

 

Comment by rhl [ 28/Oct/21 ]

Thank you for the details.  Are you able to produce the positions of the black spots in PFI mm?  Otherwise, we have to redo all this work to convert back from 71M to PFI coordinates, to allow us to work in MCS pixel coordinates.

 

Comment by Kiyoto Yabe [ 29/Oct/21 ]

I added a notebook to convert to mm here:

https://github.com/Subaru-PFS/pfs_utils/blob/u/kiyoyabe/dot_measurements_subaru_202107/notebooks/kiyoyabe/getDotPositionOnPfiCoordinate_yabe_subaru_20210710.ipynb

The resulting locations are in:

https://github.com/Subaru-PFS/pfs_utils/blob/u/kiyoyabe/dot_measurements_subaru_202107/notebooks/kiyoyabe/black_dots_mm_kiyoyabe.csv

My result is a bit different from those in the file in `pfs_instdata`

https://github.com/Subaru-PFS/pfs_instdata/blob/master/data/pfi/dot/black_dots_mm.csv

by about 200 um, which may be consistent with the difference we saw last time, but I'm not sure.

So, could you please check by using my new location to see whether things make sense?

If the new file works, I will push it to more proper place (maybe `pfs_instdata`?).

 

 

Comment by Kiyoto Yabe [ 10/Nov/21 ]

I finally gave up working with 71M for the dot position in mm because I cannot remove non-negligible residual after taking into consideration the non-telecentricity of 71M, instead I found a way to deal with the on-telescope dot data with MCS camera. Although it is not perfect, the result looks reasonable. The attached plot is the position and radius of dots on MCS image (randomly selected; red for the new and blue for the old one), which is converted from PFI mm to MCS pix using PfiTransform class and the new list of dots (in PFI mm) and looks better than before. 

This is the result for EL=90 deg. and I also have lists for other elevations but I don't think they are reliable because the original images are not good.

I'm still working on cleaning up notebooks and making the final products with reasonable filename. I hope to push them to the repository soon.

Comment by hassan [ 29/Apr/22 ]

Princeton plan to obtain data during the May 2022 engineering run as a function of elevation angle for the dot-crossing exercise (PIPE2D-1018). This ticket will be addressed by that activity. This ticket may be closed and replaced by a new ticket to capture that activity.

Comment by Kiyoto Yabe [ 29/Apr/22 ]

It sounds reasonable to me.

Comment by yuki.moritani [ 27/Nov/22 ]

Updates: During 2022 November run, dot position was measured at EL=60 and EL=30.

Comment by yuki.moritani [ 30/Nov/22 ]

The data are stored on pfs_instddata:

https://github.com/Subaru-PFS/pfs_instdata/tree/master/data/pfi/dot

 

Comment by hassan [ 30/Nov/22 ]

Arnaud has written dot position data taken above to pfs_instdata.

Comment by yuki.moritani [ 01/Dec/22 ]

I quickly compared measured position

  • As Arnaud mentioned during the engineering run, difference in position between the three EL is less than 50um.
  • Compared to the measured position at EL=90 (September 2022), ~20 um systematic shift is seen in Y, which is orthogonal direction to gravity. It might be caused by measurement.

We need to discuss if we need to define the dot positions depending on EL. If 50 um of difference is OK, using the position at EL=90 will be fine.

Comment by yuki.moritani [ 06/Jan/23 ]

We discussed this ticked at ICS/PFI+MCS meeting on 9 Dec 2022 and agreed to check repeatability first.

Comment by yuki.moritani [ 23/Feb/23 ]

Since the engineering runs in 2022 December and 2023 February were canceled, I move this to backlog now.

Comment by yuki.moritani [ 02/Aug/23 ]

Dot position was measured at EL=90, 60 and 30 during the July 2023 run. However, it was found that POpt2 was not set correctly at EL=60 and 30. (i.e. Hexapod and ADC was not synchronised with EL), Measured position was clearly affected by distortion of POpt2 (ADC). So repeatability of EL dependency should be checked to the next run.

On the other hand, repeatability at EL=90 can be compared among the data from the runs in Nov 2022, Apr/May 2023 and July 2023.

Generated at Sat Feb 10 16:34:59 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.