[PIPE2D-726] Regenerate detectorMap shifted in spatial direction for SuNSS Created: 17/Feb/21  Updated: 18/Feb/21  Resolved: 18/Feb/21

Status: Done
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Story Priority: Normal
Reporter: hassan Assignee: price
Resolution: Done Votes: 0
Labels: SuNSS
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Relates
relates to PIPE2D-727 Regenerate calib for SuNSS Won't Fix
Story Points: 2
Sprint: 2DDRP-2021 A 2

 Description   

As discussed during the internal meeting at Princeton 2021-02-15: an adjusted detectorMap is needed for SuNSS data processing, with the adjustment being a few pixels along the spatial axis.

Note that as no arc data are available, flats have to be used to provide the spatial shift.

 Comments   
Comment by price [ 18/Feb/21 ]

I have not followed the details on the pixel offset. Can this involve simply re-running the detectorMap creation from last week (PIPE2D-709) with fixed code, or do I need to manually hack the detectorMap?

Comment by price [ 18/Feb/21 ]

Word is that this was just repeating PIPE2D-709. I took the opportunity to put the calibs into a SuNSS-specific calibs repo: /projects/HSC/PFS/Subaru/CALIB-SuNSS.

setup pfs_pipe2d w.2021.07a
setup -jr /path/to/obs_pfs  # PIPE2D-731
mkdir /projects/HSC/PFS/Subaru/CALIB-SuNSS
ingestPfsCalibs.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-SuNSS $DRP_PFS_DATA_DIR/detectorMap/detectorMap-sim-*.fits --mode=copy --validity 10000

constructPfsBias.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-SuNSS --rerun=price/pipe2d-726/bias --doraise --batch-type=smp --cores=20 --id visit=45677..45691
ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/projects/HSC/PFS/Subaru/CALIB-SuNSS --validity=1800 --doraise --mode=copy -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-726/bias/BIAS/*.fits
constructPfsDark.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-SuNSS --rerun=price/pipe2d-726/dark --doraise --batch-type=smp --cores=20 --id visit=45692..45706
ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/projects/HSC/PFS/Subaru/CALIB-SuNSS --validity=1800 --doraise --mode=copy -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-726/dark/DARK/*.fits

bootstrapDetectorMap.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-SuNSS --rerun price/pipe2d-726/bootstrap --flatId visit=45742 --arcId visit=45744 arm=r -c spatialOrder=1 spectralOrder=1 isr.doFlat=False

bootstrap INFO: Found 451 lines in 10 traces
bootstrap INFO: Matched 377 lines
bootstrap INFO: Median difference from detectorMap: -3.886256,-5.738731 pixels
bootstrap INFO: Fit 200/227 points, rms: x=0.054268 y=0.081699 total=0.053583 pixels
bootstrap INFO: Median difference from detectorMap: -4.659757,-4.377080 pixels
bootstrap INFO: Fit 132/150 points, rms: x=0.118233 y=0.070910 total=0.071716 pixels

bootstrapDetectorMap.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-SuNSS --rerun price/pipe2d-726/bootstrap --flatId visit=45739 --arcId visit=45744 arm=b -c spatialOrder=1 spectralOrder=1 isr.doFlat=False

bootstrap INFO: Found 184 lines in 10 traces
bootstrap INFO: Matched 173 lines
bootstrap INFO: Median difference from detectorMap: 11.357582,-4.912592 pixels
bootstrap INFO: Fit 88/104 points, rms: x=0.034590 y=0.060081 total=0.036560 pixels
bootstrap INFO: Median difference from detectorMap: -1.673996,-7.572082 pixels
bootstrap INFO: Fit 46/69 points, rms: x=0.046296 y=0.032316 total=0.017227 pixels

ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/projects/HSC/PFS/Subaru/CALIB-SuNSS --validity=1800 --doraise --mode=copy --config clobber=True -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-726/bootstrap/DETECTORMAP/*.fits

constructFiberProfiles.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-SuNSS --rerun=price/pipe2d-726/profiles --doraise --batch-type=smp --cores=20 --id visit=45739^45742 -c isr.doFlat=False

ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/projects/HSC/PFS/Subaru/CALIB-SuNSS --validity=1800 --doraise --mode=copy --config clobber=True -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-726/profiles/FIBERPROFILES/*.fits

reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-SuNSS --rerun=price/pipe2d-726/detectorMap --doraise --id visit=45743..45746 arm=b -c reduceExposure.isr.doFlat=False -j 5

reduceArc.fitDetectorMap INFO: Final fit: chi2=615.954922 dof=698 xRMS=0.018458 yRMS=0.025075 (0.001703 nm, 0.986956 km/s) from 377/418 lines
reduceArc.fitDetectorMap INFO: Fit quality from reserved lines: chi2=122.180870 xRMS=0.065494 yRMS=0.126663 (0.008604 nm, 4.985502 km/s) from 47 lines (10.1%)
reduceArc.fitDetectorMap INFO: Softening errors by 0.007493 pixels (0.000509 nm, 0.294919 km/s) to yield chi^2/dof=1
reduceArc.fitDetectorMap INFO: Softened fit: chi2=696.817664 dof=698 xRMS=0.016929 yRMS=0.022565 (0.001533 nm, 0.888149 km/s) from 377/465 lines
reduceArc.fitDetectorMap INFO: Softened fit quality from reserved lines: chi2=132.350812 xRMS=0.063791 yRMS=0.125271 (0.008509 nm, 4.930693 km/s) from 47 lines (10.1%)

reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-SuNSS --rerun=price/pipe2d-726/detectorMap --doraise --id visit=45743..45746 arm=r -c reduceExposure.isr.doFlat=False -j 5

reduceArc.fitDetectorMap INFO: Final fit: chi2=2645.195158 dof=1970 xRMS=0.024740 yRMS=0.025849 (0.002220 nm, 0.828712 km/s) from 1013/1329 lines
reduceArc.fitDetectorMap INFO: Fit quality from reserved lines: chi2=7656.650700 xRMS=0.065076 yRMS=0.059987 (0.005151 nm, 1.923178 km/s) from 148 lines (10.0%)
reduceArc.fitDetectorMap INFO: Softening errors by 0.019658 pixels (0.001688 nm, 0.630242 km/s) to yield chi^2/dof=1
reduceArc.fitDetectorMap INFO: Softened fit: chi2=1960.904413 dof=1970 xRMS=0.031961 yRMS=0.034027 (0.002922 nm, 1.090895 km/s) from 1013/1477 lines
reduceArc.fitDetectorMap INFO: Softened fit quality from reserved lines: chi2=3347.471697 xRMS=0.064295 yRMS=0.057573 (0.004944 nm, 1.845776 km/s) from 148 lines (10.0%)

ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/projects/HSC/PFS/Subaru/CALIB-SuNSS --validity=1800 --doraise --mode=copy --config clobber=True -- /projects/HSC/PFS/Subaru/rerun/price/pipe2d-726/detectorMap/DETECTORMAP/*.fits
Comment by price [ 18/Feb/21 ]

Advertised its existence, and RHL is copying it to the mountain.

Generated at Sat Feb 10 15:56:58 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.