-
Type:
Task
-
-
Priority:
Normal
-
Resolution:
Won't Fix
-
Affects Version/s:
None
-
Fix Version/s:
None
-
Component/s:
None
-
When looking at creating dithered images (PIPE2D-581) I noticed that dithered images are looking suspicious. arnaud.lefur and I did some investigative work, presented in the following figures:
1) Dithering_May14.png - shows by how much the center of flux changes between images after dithering. I created results for the sequence of only 4 dithers (4440-4463) and the sequence of 9 dithers (4720-4773), taken at Subaru. Also added is the data from the last LAM dithered acquisition (4 dither positions, 21256-21279). I conclude 3 things:
a) Subaru and LAM results are different
b) final LAM dataset is also not perfect - at some point in the past the values for dithering were deduced by arnaud.lefur so that dithering was ``perfect''.
c) there is also potentially the difference between the results when depending on the sequence of moves (the difference between yellow and black data), but this would have to be further investigated in order to make a certain claim.
I am also attaching Figure Dithering_May13_Arnaud, which shows the analysis did by Arnaud which mimicking the black points from the previous plot. The results are consistent.
Finally, I am also attaching Figure Dithering_pixels_added_simulation.png, which was the original Figure showing this effect that was discussed on Slack.
{"report":{"apdex":0,"isInitial":true,"journeyId":"476cd50d-b802-478f-bc72-678b49579b6d","key":"jira.project.issue.view-issue","navigationType":0,"readyForUser":7092.099999427795,"redirectCount":0,"resourceLoadedEnd":6987.199999809265,"resourceLoadedStart":804.1999998092651,"resourceTiming":[{"duration":6.899999618530273,"initiatorType":"link","name":"https://pfspipe.ipmu.jp/jira/s/6857d0cccf13aeaceb2c3277c6bf3892-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/0a4716d29b2d5b1bdcdb168b4efc119e/_/download/contextbatch/css/_super/batch.css","startTime":804.1999998092651,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":804.1999998092651,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":811.0999994277954,"responseStart":0,"secureConnectionStart":0},{"duration":6.90000057220459,"initiatorType":"link","name":"https://pfspipe.ipmu.jp/jira/s/4ca5cf1725eaa25a0e132608060337f8-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/53bc49863274d15a772d711431705c0c/_/download/contextbatch/css/project.issue.navigator,jira.view.issue,jira.global,jira.general,atl.general,-_super/batch.css?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&richediton=true","startTime":804.5999994277954,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":804.5999994277954,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":811.5,"responseStart":0,"secureConnectionStart":0},{"duration":7.399999618530273,"initiatorType":"link","name":"https://pfspipe.ipmu.jp/jira/s/d41d8cd98f00b204e9800998ecf8427e-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/8.0.5/_/download/batch/com.atlassian.auiplugin:split_aui.pattern.label/com.atlassian.auiplugin:split_aui.pattern.label.css","startTime":804.6999998092651,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":804.6999998092651,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":812.0999994277954,"responseStart":0,"secureConnectionStart":0},{"duration":7.800000190734863,"initiatorType":"link","name":"https://pfspipe.ipmu.jp/jira/s/6f741955bf751f5684bb05515ecce171-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/1.0/_/download/batch/jira.webresources:global-static-adgs/jira.webresources:global-static-adgs.css","startTime":804.8999996185303,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":804.8999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":812.6999998092651,"responseStart":0,"secureConnectionStart":0},{"duration":8.5,"initiatorType":"link","name":"https://pfspipe.ipmu.jp/jira/s/9b2891edfaa54fe476fe450e110e4428-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/1.0/_/download/batch/jira.webresources:global-static/jira.webresources:global-static.css","startTime":805,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":805,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":813.5,"responseStart":0,"secureConnectionStart":0},{"duration":1835.8999996185303,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/71200f8ce5613e097dcbc84ab48f0df3-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/0a4716d29b2d5b1bdcdb168b4efc119e/_/download/contextbatch/js/_super/batch.js?locale=en-US","startTime":805.3000001907349,"connectEnd":1180,"connectStart":817.3000001907349,"domainLookupEnd":817.3000001907349,"domainLookupStart":817.3000001907349,"fetchStart":805.3000001907349,"redirectEnd":0,"redirectStart":0,"requestStart":1180,"responseEnd":2641.199999809265,"responseStart":1554.3999996185303,"secureConnectionStart":998.3999996185303},{"duration":2012.6999998092651,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/47d93b27a0f146b1bd3f1d197220131e-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/53bc49863274d15a772d711431705c0c/_/download/contextbatch/js/project.issue.navigator,jira.view.issue,jira.global,jira.general,atl.general,-_super/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en-US&richediton=true","startTime":805.3999996185303,"connectEnd":1180.1999998092651,"connectStart":818,"domainLookupEnd":818,"domainLookupStart":818,"fetchStart":805.3999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":1180.3000001907349,"responseEnd":2818.0999994277954,"responseStart":1553.1999998092651,"secureConnectionStart":999.0999994277954},{"duration":573.1000003814697,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/70bb2263e59e7e1f04fbd137c80b895b-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/aae1242f5fc81cc6a5bb8bc963ccda29/_/download/contextbatch/js/atl.global,-_super/batch.js?locale=en-US","startTime":805.5999994277954,"connectEnd":1181,"connectStart":817.8999996185303,"domainLookupEnd":817.8999996185303,"domainLookupStart":817.8999996185303,"fetchStart":805.5999994277954,"redirectEnd":0,"redirectStart":0,"requestStart":1181.0999994277954,"responseEnd":1378.6999998092651,"responseStart":1378,"secureConnectionStart":998.8000001907349},{"duration":565.0999994277954,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/d41d8cd98f00b204e9800998ecf8427e-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/1.0/_/download/batch/jira.webresources:calendar-en/jira.webresources:calendar-en.js","startTime":805.8000001907349,"connectEnd":1181.8000001907349,"connectStart":818.3999996185303,"domainLookupEnd":818.3999996185303,"domainLookupStart":818.3999996185303,"fetchStart":805.8000001907349,"redirectEnd":0,"redirectStart":0,"requestStart":1181.8999996185303,"responseEnd":1370.8999996185303,"responseStart":1370.1999998092651,"secureConnectionStart":999.8999996185303},{"duration":581.1999998092651,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/d41d8cd98f00b204e9800998ecf8427e-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/1.0/_/download/batch/jira.webresources:calendar-localisation-moment/jira.webresources:calendar-localisation-moment.js","startTime":805.8999996185303,"connectEnd":1195.5999994277954,"connectStart":819.5999994277954,"domainLookupEnd":819.5999994277954,"domainLookupStart":819.5999994277954,"fetchStart":805.8999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":1195.6999998092651,"responseEnd":1387.0999994277954,"responseStart":1386.5,"secureConnectionStart":1007.1999998092651},{"duration":750.6000003814697,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/69508eac48a2781e76116ef9aaf97558-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/8.0.5/_/download/batch/com.atlassian.auiplugin:split_aui.pattern.label/com.atlassian.auiplugin:split_aui.pattern.label.js?locale=en-US","startTime":806.0999994277954,"connectEnd":806.0999994277954,"connectStart":806.0999994277954,"domainLookupEnd":806.0999994277954,"domainLookupStart":806.0999994277954,"fetchStart":806.0999994277954,"redirectEnd":0,"redirectStart":0,"requestStart":1371.3999996185303,"responseEnd":1556.6999998092651,"responseStart":1556.0999994277954,"secureConnectionStart":806.0999994277954},{"duration":14.5,"initiatorType":"link","name":"https://pfspipe.ipmu.jp/jira/s/cddefc452def736b814cb1124eb8715f-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/6d15dbc1919cf2c5ddb9c9153d7f06f9/_/download/contextbatch/css/jira.global.look-and-feel,-_super/batch.css","startTime":806.5,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":806.5,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":821,"responseStart":0,"secureConnectionStart":0},{"duration":759.6000003814697,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/rest/api/1.0/shortcuts/803005/36457a83252da76e0efa441a4fb3275c/shortcuts.js?context=issuenavigation&context=issueaction","startTime":806.6999998092651,"connectEnd":806.6999998092651,"connectStart":806.6999998092651,"domainLookupEnd":806.6999998092651,"domainLookupStart":806.6999998092651,"fetchStart":806.6999998092651,"redirectEnd":0,"redirectStart":0,"requestStart":1379.0999994277954,"responseEnd":1566.3000001907349,"responseStart":1565.5999994277954,"secureConnectionStart":806.6999998092651},{"duration":210.39999961853027,"initiatorType":"xmlhttprequest","name":"https://pfspipe.ipmu.jp/jira/rest/webResources/1.0/resources","startTime":2785.300000190735,"connectEnd":2785.300000190735,"connectStart":2785.300000190735,"domainLookupEnd":2785.300000190735,"domainLookupStart":2785.300000190735,"fetchStart":2785.300000190735,"redirectEnd":0,"redirectStart":0,"requestStart":2805.5999994277954,"responseEnd":2995.699999809265,"responseStart":2995.0999994277954,"secureConnectionStart":2785.300000190735},{"duration":209.5,"initiatorType":"xmlhttprequest","name":"https://pfspipe.ipmu.jp/jira/rest/webResources/1.0/resources","startTime":2999.199999809265,"connectEnd":2999.199999809265,"connectStart":2999.199999809265,"domainLookupEnd":2999.199999809265,"domainLookupStart":2999.199999809265,"fetchStart":2999.199999809265,"redirectEnd":0,"redirectStart":0,"requestStart":3003.8999996185303,"responseEnd":3208.699999809265,"responseStart":3208.0999994277954,"secureConnectionStart":2999.199999809265},{"duration":193.29999923706055,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/d41d8cd98f00b204e9800998ecf8427e-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/be9ff0efea54a6453d2ac60b92912a09/_/download/contextbatch/js/browser-metrics-plugin.contrib,-_super,-project.issue.navigator,-jira.view.issue,-atl.general/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&richediton=true","startTime":3211.300000190735,"connectEnd":3211.300000190735,"connectStart":3211.300000190735,"domainLookupEnd":3211.300000190735,"domainLookupStart":3211.300000190735,"fetchStart":3211.300000190735,"redirectEnd":0,"redirectStart":0,"requestStart":3218,"responseEnd":3404.5999994277954,"responseStart":3403.699999809265,"secureConnectionStart":3211.300000190735},{"duration":225.19999980926514,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/60b149f8612227a8a0101c9bd56148b4-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/ea7e7a11d1f628533837874704f9a54d/_/download/contextbatch/js/jira.rich.editor.api,jira.rich.editor,-_super,-jira.view.issue,-jira.global,-atl.general,-project.issue.navigator/batch.js?agile_global_admin_condition=true&jag=true&jira.create.linked.issue=true&locale=en-US&richediton=true","startTime":3211.8999996185303,"connectEnd":3211.8999996185303,"connectStart":3211.8999996185303,"domainLookupEnd":3211.8999996185303,"domainLookupStart":3211.8999996185303,"fetchStart":3211.8999996185303,"redirectEnd":0,"redirectStart":0,"requestStart":3218.300000190735,"responseEnd":3437.0999994277954,"responseStart":3408.800000190735,"secureConnectionStart":3211.8999996185303},{"duration":392.3999996185303,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/d41d8cd98f00b204e9800998ecf8427e-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/4.0.25/_/download/resources/com.atlassian.jira.plugins.jira-editor-plugin:tinymce/tinymce.js?batch=false","startTime":3212.5,"connectEnd":3212.5,"connectStart":3212.5,"domainLookupEnd":3212.5,"domainLookupStart":3212.5,"fetchStart":3212.5,"redirectEnd":0,"redirectStart":0,"requestStart":3409.800000190735,"responseEnd":3604.8999996185303,"responseStart":3595.5999994277954,"secureConnectionStart":3212.5},{"duration":413.3999996185303,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/d41d8cd98f00b204e9800998ecf8427e-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/4.0.25/_/download/resources/com.atlassian.jira.plugins.jira-editor-plugin:tinymce/tinymce-amd.js?batch=false","startTime":3212.800000190735,"connectEnd":3212.800000190735,"connectStart":3212.800000190735,"domainLookupEnd":3212.800000190735,"domainLookupStart":3212.800000190735,"fetchStart":3212.800000190735,"redirectEnd":0,"redirectStart":0,"requestStart":3441.3999996185303,"responseEnd":3626.199999809265,"responseStart":3625.5,"secureConnectionStart":3212.800000190735},{"duration":585.8000001907349,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/d41d8cd98f00b204e9800998ecf8427e-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/4.0.25/_/download/resources/com.atlassian.jira.plugins.jira-editor-plugin:tinymce/themes/modern/theme.js?batch=false","startTime":3213.0999994277954,"connectEnd":3213.0999994277954,"connectStart":3213.0999994277954,"domainLookupEnd":3213.0999994277954,"domainLookupStart":3213.0999994277954,"fetchStart":3213.0999994277954,"redirectEnd":0,"redirectStart":0,"requestStart":3614.300000190735,"responseEnd":3798.8999996185303,"responseStart":3798.300000190735,"secureConnectionStart":3213.0999994277954},{"duration":2.5,"initiatorType":"link","name":"https://pfspipe.ipmu.jp/jira/s/1e83d960b274809d77d87cc5d08ac9f0-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/4a9288299d147101bf66484f4be48925/_/download/contextbatch/css/com.atlassian.jira.projects.sidebar.init,-_super,-jira.view.issue,-project.issue.navigator/batch.css?jira.create.linked.issue=true&richediton=true","startTime":6606,"connectEnd":0,"connectStart":0,"domainLookupEnd":0,"domainLookupStart":0,"fetchStart":6606,"redirectEnd":0,"redirectStart":0,"requestStart":0,"responseEnd":6608.5,"responseStart":0,"secureConnectionStart":0},{"duration":380.80000019073486,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/d40a034b2ad49fe248d3d34e35e494ff-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/4a9288299d147101bf66484f4be48925/_/download/contextbatch/js/com.atlassian.jira.projects.sidebar.init,-_super,-jira.view.issue,-project.issue.navigator/batch.js?jira.create.linked.issue=true&locale=en-US&richediton=true","startTime":6606.39999961853,"connectEnd":6606.39999961853,"connectStart":6606.39999961853,"domainLookupEnd":6606.39999961853,"domainLookupStart":6606.39999961853,"fetchStart":6606.39999961853,"redirectEnd":0,"redirectStart":0,"requestStart":6610,"responseEnd":6987.199999809265,"responseStart":6986.300000190735,"secureConnectionStart":6606.39999961853},{"duration":191.5,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/d41d8cd98f00b204e9800998ecf8427e-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/1.0/_/download/batch/jira.webresources:bigpipe-js/jira.webresources:bigpipe-js.js","startTime":6794.300000190735,"connectEnd":6794.300000190735,"connectStart":6794.300000190735,"domainLookupEnd":6794.300000190735,"domainLookupStart":6794.300000190735,"fetchStart":6794.300000190735,"redirectEnd":0,"redirectStart":0,"requestStart":6799.099999427795,"responseEnd":6985.800000190735,"responseStart":6985.300000190735,"secureConnectionStart":6794.300000190735},{"duration":189.60000038146973,"initiatorType":"script","name":"https://pfspipe.ipmu.jp/jira/s/d41d8cd98f00b204e9800998ecf8427e-CDN/s4249o/803005/d03c5b13c84abbbcc687d02f1534e41c/1.0/_/download/batch/jira.webresources:bigpipe-init/jira.webresources:bigpipe-init.js","startTime":6794.599999427795,"connectEnd":6794.599999427795,"connectStart":6794.599999427795,"domainLookupEnd":6794.599999427795,"domainLookupStart":6794.599999427795,"fetchStart":6794.599999427795,"redirectEnd":0,"redirectStart":0,"requestStart":6799.199999809265,"responseEnd":6984.199999809265,"responseStart":6983.599999427795,"secureConnectionStart":6794.599999427795}],"threshold":1000,"fetchStart":0,"domainLookupStart":5,"domainLookupEnd":225,"connectStart":225,"connectEnd":594,"secureConnectionStart":408,"requestStart":595,"responseStart":799,"responseEnd":6793,"domLoading":803,"domInteractive":7175,"domContentLoadedEventStart":7175,"domContentLoadedEventEnd":7257,"domComplete":7257,"loadEventStart":7257,"loadEventEnd":7260,"userAgent":"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)","marks":[],"measures":[],"correlationId":"9c342aa15078a8","effectiveType":"4g","downlink":9.7,"rtt":0,"serverDuration":5851,"dbReadsTimeInMs":15,"dbConnsTimeInMs":19,"applicationHash":"1f96e09b3c60279a408a2ae47be3c745f571388b","experiments":[]}}
I have added some further images. Dithering_May19 shows a complete list of all dithering images that we ever took at LAM or Subaru. The points show the median difference after a dithering movement, deduced from many HgAr spots across the detector. The error bars show the 16%-84% quantile of the results.
Single_example.png shows the example of the same spot in the July LAM data and Subaru data. The title above the figure shows the centroid of the 20x20 image. I am showing only the center 10x10 pixels so that the images are clearer. You can clearly see the difference between dithered images, even though the movement of the slit is nominally the same for two locations.