[PIPE2D-430] Interpolate over negative variances Created: 23/May/19  Updated: 23/Sep/23

Status: Open
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Story Priority: Normal
Reporter: price Assignee: price
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Relates
relates to PIPE2D-1096 Negative variance pixels are seen in ... Done
relates to PIPE2D-427 reduceArc.py fails with HgAr data tak... Done
Story Points: 2
Sprint: 2DDRP-2019 E, 2DDRP-2021 A 8, 2DDRP-2021 A 10

 Description   

In PIPE2D-427, we fixed a negative variance in the post-ISR image by masking it and setting the variance to inf. @rhl writes:

The problem is that the variance is being calculated after bias and dark subtraction as the number of photons. Firstly, the dark current must be included in the variance (maybe this was a typo?). More importantly, the variance shouldn't be the measured number of photons but its expectation value.

Masking pixels that end up negative biases the image, and this is a problem. I think that we won't need to do any masking; if we do, we need to think harder about the consequences.

Even if the pixel must be taken as bad (which is not, I think, correct) please do not set the variance to infinity; that causes biases too. You should interpolate the variance at the same time as interpolating the image (and setting BAD).


Generated at Sat Feb 10 15:53:05 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.