[PIPE2D-616] Compute 2nd moments for Med Res data Created: 16/Jul/20  Updated: 05/Jan/21  Resolved: 05/Sep/20

Status: Done
Project: DRP 2-D Pipeline
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Normal
Reporter: hassan Assignee: hassan
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: PDF File PFS PIPE2D-616.pdf     File pipe2d-616.py     PNG File shape.png    
Story Points: 3
Sprint: 2DDRP-2021 A
Reviewers: hassan

 Description   

With respect to determining the alignment for medium resolution exposures, as discussed today during the SpS hardware telecon, please compute using the 2D DRP second moments for the following medium-resolution HgAr visit sets:  

3443...3450
18052...18059

and the following lines:

696.7352, 727.494 , 795.0362, 912.5471, 966.0435

Note that as the above data are based on the HgAr lamp, the continuum needs to be removed.

These data would be used to compare with the plots generated by fmadec using the SEP python module (https://sep.readthedocs.io/en/v1.0.x/) in slide 12 of the following presentation: https://sumire.pbworks.com/w/file/fetch/140734437/LAM_Subaru_SM1_20200715.pdf

So a similar set of plots should be generated for this ticket.



 Comments   
Comment by hassan [ 16/Jul/20 ]

Please start with processing the post-migration visit_set (18052...18059) which should currently be available on tigress.

Comment by rhl [ 16/Jul/20 ]

We need to be quite careful here. The background (including continuum) subtraction has to be done carefully, and a non-trivial moment calculation used (HSM would be my first choice)

Comment by price [ 16/Jul/20 ]

Is it not necessary to use SExtractor in order to compare apples-to-apples with the plots in the presentation?

Comment by price [ 14/Aug/20 ]

Please let me know if this is still desired, or if it is moot following the acquisition of new data.

Comment by hassan [ 14/Aug/20 ]

Yes, this is still desired. The data haven't yet been acquired from SM1. I'm hoping by early next week.

Comment by cloomis [ 20/Aug/20 ]

Data taken. The command sequence was: 

start at low res
take 1xflat + 3xarc

for rep in 1..5:
     move to med res
     take 1xflat + 3xarc
 
     move to low res
     take 1xflat + 3xarc
 

And the arcs are neon=50 argon=50 krypton=50

The acquisition log is:

set_id|sequence_type|name|start_date         |min_visit|max_visit|cmd_str                                                                         |
------|-------------|----|-------------------|---------|---------|--------------------------------------------------------------------------------|
  1348|flats        |    |2020-08-17 17:02:30|    23743|    23743|expose flat halogen=3 comments=test_gratingMotion_0                             |
  1349|arcs         |    |2020-08-17 17:03:34|    23744|    23746|expose arc neon=50 argon=50 krypton=50 duplicate=3 comments=test_gratingMotion_0|
  1350|flats        |    |2020-08-17 17:11:45|    23747|    23747|expose flat halogen=3 comments=test_gratingMotion_1                             |
  1351|arcs         |    |2020-08-17 17:12:49|    23748|    23750|expose arc neon=50 argon=50 krypton=50 duplicate=3 comments=test_gratingMotion_1|
  1352|flats        |    |2020-08-17 17:20:58|    23751|    23751|expose flat halogen=3 comments=test_gratingMotion_1                             |
  1353|arcs         |    |2020-08-17 17:22:03|    23752|    23754|expose arc neon=50 argon=50 krypton=50 duplicate=3 comments=test_gratingMotion_1|
  1354|flats        |    |2020-08-17 17:30:12|    23755|    23755|expose flat halogen=3 comments=test_gratingMotion_2                             |
  1355|arcs         |    |2020-08-17 17:31:17|    23756|    23758|expose arc neon=50 argon=50 krypton=50 duplicate=3 comments=test_gratingMotion_2|
  1356|flats        |    |2020-08-17 17:39:26|    23759|    23759|expose flat halogen=3 comments=test_gratingMotion_2                             |
  1357|arcs         |    |2020-08-17 17:40:30|    23760|    23762|expose arc neon=50 argon=50 krypton=50 duplicate=3 comments=test_gratingMotion_2|
  1358|flats        |    |2020-08-17 17:48:39|    23763|    23763|expose flat halogen=3 comments=test_gratingMotion_3                             |
  1359|arcs         |    |2020-08-17 17:49:43|    23764|    23766|expose arc neon=50 argon=50 krypton=50 duplicate=3 comments=test_gratingMotion_3|
  1360|flats        |    |2020-08-17 17:57:53|    23767|    23767|expose flat halogen=3 comments=test_gratingMotion_3                             |
  1361|arcs         |    |2020-08-17 17:58:57|    23768|    23770|expose arc neon=50 argon=50 krypton=50 duplicate=3 comments=test_gratingMotion_3|
  1362|flats        |    |2020-08-17 18:07:06|    23771|    23771|expose flat halogen=3 comments=test_gratingMotion_4                             |
  1363|arcs         |    |2020-08-17 18:08:11|    23772|    23774|expose arc neon=50 argon=50 krypton=50 duplicate=3 comments=test_gratingMotion_4|
  1364|flats        |    |2020-08-17 18:16:19|    23775|    23775|expose flat halogen=3 comments=test_gratingMotion_4                             |
  1365|arcs         |    |2020-08-17 18:17:23|    23776|    23778|expose arc neon=50 argon=50 krypton=50 duplicate=3 comments=test_gratingMotion_4|
  1366|flats        |    |2020-08-17 18:25:33|    23779|    23779|expose flat halogen=3 comments=test_gratingMotion_5                             |
  1367|arcs         |    |2020-08-17 18:26:37|    23780|    23782|expose arc neon=50 argon=50 krypton=50 duplicate=3 comments=test_gratingMotion_5|
  1368|flats        |    |2020-08-17 18:34:49|    23783|    23783|expose flat halogen=3 comments=test_gratingMotion_5                             |
  1369|arcs         |    |2020-08-17 18:35:53|    23784|    23786|expose arc neon=50 argon=50 krypton=50 duplicate=3 comments=test_gratingMotion_5|
Comment by price [ 21/Aug/20 ]

The measurements are on the tiger cluster in /tigress/pprice/pipe2d-616, in the same format as used for measurements by the LSST pipeline (FITS tables, first HDU is of the most interest).

Comment by price [ 21/Aug/20 ]

The below plot shows the measured shape of all lines as a function of x,y on the detector. The user will probably want to threshold the list of lines by the flux, multiple measures of which are in the catalogs.

Comment by price [ 21/Aug/20 ]
sqlite> SELECT visit, GROUP_CONCAT(arm), pfsDesignId, field, lamps, exptime, attenuator, dither, shift, focus FROM raw WHERE visit BETWEEN 23743 AND 23782 GROUP
 BY visit;
23743|r,b|1099528409104|FLAT|Quartz|3.0|-9998.0|0.0|0.0|-0.0003
23744|r,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23745|r,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23746|r,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23747|b,m|1099528409104|FLAT|Quartz|3.0|-9998.0|0.0|0.0|-0.0003
23748|m,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23749|m,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23750|b,m|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23751|b,r|1099528409104|FLAT|Quartz|3.0|-9998.0|0.0|0.0|-0.0003
23752|b,r|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23753|b,r|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23754|b,r|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23755|m,b|1099528409104|FLAT|Quartz|3.0|-9998.0|0.0|0.0|-0.0003
23756|m,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23757|m,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23758|m,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23759|b,r|1099528409104|FLAT|Quartz|3.0|-9998.0|0.0|0.0|-0.0003
23760|b,r|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23761|b,r|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23762|b,r|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23763|b,m|1099528409104|FLAT|Quartz|3.0|-9998.0|0.0|0.0|-0.0003
23764|m,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23765|m,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23766|m,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23767|b,r|1099528409104|FLAT|Quartz|3.0|-9998.0|0.0|0.0|-0.0003
23768|r,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23769|r,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23770|r,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23771|m,b|1099528409104|FLAT|Quartz|3.0|-9998.0|0.0|0.0|-0.0003
23772|b,m|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23773|m,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23774|b,m|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23775|b,r|1099528409104|FLAT|Quartz|3.0|-9998.0|0.0|0.0|-0.0003
23776|b,r|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23777|b,r|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23778|r,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23779|m,b|1099528409104|FLAT|Quartz|3.0|-9998.0|0.0|0.0|-0.0003
23780|m,b|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23781|b,m|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003
23782|b,m|1099528409104|COMPARISON|Ar,Kr,Ne|50.0|-9998.0|0.0|0.0|-0.0003

(lsst-scipipe) pprice@tiger2-sumire:/projects/HSC/PFS/Subaru $ ingestPfsImages.py /projects/HSC/PFS/Subaru --pfsConfigDir /projects/HSC/PFS/Subaru/drp/pfsDesign --config parse.pfsDesignId=1099528409104 --ignore-ingested -- '/projects/HSC/PFS/Subaru/raw/2020-08-*/sps/PFSA*.fits'

The last r/m biases were 6 weeks ago (2020-06-30), probably taken as part of the stability test (PIPE2D-618). Will push forward assuming those are good enough.

Steps:
1. Bootstrap a valid detectorMap.
2. Generate fiberTrace.
3. Process the arc to get a really good detectorMap.
4. Use custom script to run LSST measurement framework on arc lines.

(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-616 $ ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/projects/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy ~/pfs/drp_pfs_data/detectorMap/detectorMap-2020Apr-m1.fits
(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-616 $ bootstrapDetectorMap.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/bootstrap --doraise --flatId visit=23747 arm=m --arcId visit=23748 arm=m

bootstrap INFO: Median difference from detectorMap: -1.268960,0.469803 pixels
bootstrap INFO: Fit 277/336 points, rms: x=0.722616 y=2.441186 total=2.069997 pixels
bootstrap INFO: Updating detectorMap...
bootstrap INFO: Median difference from detectorMap: 0.698470,0.597844 pixels
bootstrap INFO: Fit 191/229 points, rms: x=0.345339 y=2.602193 total=2.158558 pixels

(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-616 $ ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/projects/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy /projects/HSC/PFS/Subaru/rerun/price/pipe2d-616/bootstrap/DETECTORMAP/pfsDetectorMap-023748-m1.fits 

(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-616 $ constructFiberTrace.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/fiberTrace --doraise --batch-type=smp --cores=1 --id visit=23747
(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-616 $ ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/projects/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy /projects/HSC/PFS/Subaru/rerun/price/pipe2d-616/fiberTrace/FIBERTRACE/pfsFiberTrace-2020-08-17-023747-m1.fits 

(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-616 $ reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23748 arm=m

reduceArc.fitDetectorMap INFO: Final fit: chi2=1121.654719 xRMS=0.154362 yRMS=1.054392 (0.049562 nm, 18.599770 km/s) from 445/473 lines
reduceArc.fitDetectorMap INFO: Fit quality from reserved lines: chi2=258.705408 xRMS=0.185894 yRMS=0.881486 (0.041434 nm, 15.549659 km/s) from 48 lines (9.1%)
reduceArc.fitDetectorMap INFO: Softening errors by 0.115597 pixels (0.005434 nm, 2.039167 km/s) to yield chi^2/dof=1
reduceArc.fitDetectorMap INFO: Softened fit: chi2=929.695791 xRMS=0.092336 yRMS=0.802256 (0.037601 nm, 14.109900 km/s) from 445/526 lines
reduceArc.fitDetectorMap INFO: Softened fit quality from reserved lines: chi2=105.743892 xRMS=0.108362 yRMS=0.697862 (0.032708 nm, 12.273840 km/s) from 48 lines (9.1%)

Having difficulty getting good wavelength fits to the m arm with the new GlobalDetectorMap (tickets/PIPE2D-358; getting systematic wavelength residuals), so revert to the current version; will work on fitting m later.

reduceArc.calibrateWavelengths INFO: FiberId 2, rms 0.003757 nm (0.081 pix) from 54/62 (0.002162 nm = 0.047 pix for 10 reserved points), 714.90-885.63 nm
reduceArc.calibrateWavelengths INFO: Fiber 2: wavelength correction -0.015799 +/- 0.010838 nm
reduceArc.calibrateWavelengths INFO: FiberId 63, rms 0.002983 nm (0.064 pix) from 53/63 (0.001688 nm = 0.036 pix for 10 reserved points), 717.59-885.63 nm
reduceArc.calibrateWavelengths INFO: Fiber 63: wavelength correction -0.018139 +/- 0.024752 nm
reduceArc.calibrateWavelengths INFO: FiberId 192, rms 0.003791 nm (0.082 pix) from 48/57 (0.004014 nm = 0.087 pix for 10 reserved points), 714.90-885.63 nm
reduceArc.calibrateWavelengths INFO: Fiber 192: wavelength correction -0.017744 +/- 0.044794 nm
reduceArc.calibrateWavelengths INFO: FiberId 255, rms 0.002789 nm (0.060 pix) from 50/63 (0.002168 nm = 0.047 pix for 10 reserved points), 714.90-885.63 nm
reduceArc.calibrateWavelengths INFO: Fiber 255: wavelength correction -0.016435 +/- 0.028260 nm
reduceArc.calibrateWavelengths INFO: FiberId 339, rms 0.002716 nm (0.058 pix) from 49/61 (0.003449 nm = 0.074 pix for 10 reserved points), 714.90-885.63 nm
reduceArc.calibrateWavelengths INFO: Fiber 339: wavelength correction -0.017634 +/- 0.021243 nm
reduceArc.calibrateWavelengths INFO: FiberId 401, rms 0.003812 nm (0.082 pix) from 50/63 (0.002040 nm = 0.044 pix for 10 reserved points), 714.90-885.63 nm
reduceArc.calibrateWavelengths INFO: Fiber 401: wavelength correction -0.011027 +/- 0.027518 nm
reduceArc.calibrateWavelengths INFO: FiberId 464, rms 0.004156 nm (0.090 pix) from 56/60 (0.004277 nm = 0.092 pix for 10 reserved points), 714.90-885.63 nm
reduceArc.calibrateWavelengths INFO: Fiber 464: wavelength correction -0.010072 +/- 0.030665 nm
reduceArc.calibrateWavelengths INFO: FiberId 525, rms 0.004800 nm (0.103 pix) from 46/55 (0.005414 nm = 0.117 pix for 10 reserved points), 714.90-885.63 nm
reduceArc.calibrateWavelengths INFO: Fiber 525: wavelength correction -0.015462 +/- 0.032322 nm
reduceArc.calibrateWavelengths INFO: FiberId 587, rms 0.003302 nm (0.071 pix) from 48/57 (0.003198 nm = 0.069 pix for 10 reserved points), 714.90-885.63 nm
reduceArc.calibrateWavelengths INFO: Fiber 587: wavelength correction -0.010947 +/- 0.030819 nm
reduceArc.calibrateWavelengths INFO: FiberId 650, rms 0.003758 nm (0.081 pix) from 49/60 (0.004431 nm = 0.096 pix for 10 reserved points), 714.90-885.63 nm
reduceArc.calibrateWavelengths INFO: Fiber 650: wavelength correction -0.020529 +/- 0.026221 nm


(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-616 $ constructFiberTrace.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/fiberTrace --doraise --batch-type=smp --cores=1 --id visit=23743 arm=r
(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-616 $ ingestPfsCalibs.py /projects/HSC/PFS/Subaru --output=/projects/HSC/PFS/Subaru/CALIB-price --validity=1800 --doraise --mode=copy /projects/HSC/PFS/Subaru/rerun/price/pipe2d-616/fiberTrace/FIBERTRACE/pfsFiberTrace-2020-08-17-023743-r1.fits 

(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-616 $ reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23744 arm=r

reduceArc.calibrateWavelengths INFO: FiberId 339, rms 0.007783 nm (0.090 pix) from 80/94 (0.005586 nm = 0.065 pix for 10 reserved points), 640.40-955.00 nm
reduceArc.calibrateWavelengths INFO: Fiber 339: wavelength correction 0.045030 +/- 0.006753 nm


reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23744..23746 arm=r -j 3 -c reduceExposure.doWriteCalexp=True
reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23748..23750 arm=m -j 3 -c reduceExposure.doWriteCalexp=True
reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23752..23754 arm=r -j 3 -c reduceExposure.doWriteCalexp=True
reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23756..23758 arm=m -j 3 -c reduceExposure.doWriteCalexp=True
reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23760..23762 arm=r -j 3 -c reduceExposure.doWriteCalexp=True
reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23764..23766 arm=m -j 3 -c reduceExposure.doWriteCalexp=True
reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23768..23770 arm=r -j 3 -c reduceExposure.doWriteCalexp=True
reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23772..23774 arm=m -j 3 -c reduceExposure.doWriteCalexp=True
reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23776..23778 arm=r -j 3 -c reduceExposure.doWriteCalexp=True
reduceArc.py /projects/HSC/PFS/Subaru --calib=/projects/HSC/PFS/Subaru/CALIB-price --rerun=price/pipe2d-616/arc --id visit=23780..23782 arm=m -j 3 -c reduceExposure.doWriteCalexp=True

(lsst-scipipe) pprice@tiger2-sumire:/tigress/pprice/pipe2d-616 $ python pipe2d-616.py /projects/HSC/PFS/Subaru --calib /projects/HSC/PFS/Subaru/CALIB-price --rerun price/pipe2d-616/arc --id visit=23744..23746^23748..23750^23752..23754^23756..23758^23760..23762^23764..23766^23768..23770^23772..23774^23776..23778^23780..23782 arm=r^m -j 20
Comment by price [ 21/Aug/20 ]

Added ext_simpleShape_SimpleShape, ext_shapeHSM_HsmSourceMoments, and ext_shapeHSM_HsmSourceMomentsRound measurements at rhl's request.

Comment by price [ 22/Aug/20 ]

This provides a clean sample:

>>> gaussMag = -2.5*np.log10(catalog["base_GaussianFlux_instFlux"])
>>> psfMag = -2.5*np.log10(catalog["base_PsfFlux_instFlux"])
>>> saturated = catalog["base_PixelFlags_flag_saturatedCenter"]
>>> select = (psfMag < -9) & (psfMag > -14) & ~saturated & (gaussMag - psfMag > -0.55)

I'm a bit concerned that this removes low-wavelength low-fiberId lines (bottom right-hand corner). Decreasing the gaussMag - psfMag limit gets them back, at the cost of admitting some contamination.

Comment by price [ 22/Aug/20 ]

I've added a numNear column, which is the number of lines within 0.4 nm. I now like the selection:

>>> select = (psfMag < -9) & (psfMag > -14) & ~saturated & (catalog["numNear"] == 0)
Comment by hassan [ 05/Sep/20 ]

Work presented to Fabrice last week. Further work necessary, but need more discussion with Fabrice, and new tickets will be filed.

Generated at Sat Feb 10 15:55:27 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.