[DAMD-141] AGCC image file TABLEn HDUs need clarification

Relates — Thu, 18 May 2023 05:33:11 +0000

For the Dec 2022 run:

Following ~~DAMD-138~~, a few things about the content of the AGCC image files need clarifying.

Looking at Sep 2022 data, in addition to the raw camera images, there are present in some of the files TABLEn HDUs that provide detection information:

Filename: /data/raw/2022-09-22/agcc/agcc_20220921_2222058.fits
No.    Name      Ver    Type      Cards   Dimensions   Format
  0  PRIMARY       1 PrimaryHDU       6   ()      
  1  CAM1          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  2  CAM2          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  3  CAM3          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  4  CAM4          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  5  CAM5          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  6  CAM6          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  7  TABLE1        1 BinTableHDU     31   81R x 10C   [E, E, E, E, E, E, I, I, E, E]   
  8  TABLE2        1 BinTableHDU     31   60R x 10C   [E, E, E, E, E, E, I, I, E, E]   
  9  TABLE3        1 BinTableHDU     31   47R x 10C   [E, E, E, E, E, E, I, I, E, E]   
 10  TABLE4        1 BinTableHDU     31   60R x 10C   [E, E, E, E, E, E, I, I, E, E]   
 11  TABLE5        1 BinTableHDU     31   68R x 10C   [E, E, E, E, E, E, I, I, E, E]   
 12  TABLE6        1 BinTableHDU     31   60R x 10C   [E, E, E, E, E, E, I, I, E, E]

XTENSION= 'BINTABLE'           / binary table extension                         
BITPIX  =                    8 / array data type                                
NAXIS   =                    2 / number of array dimensions                     
NAXIS1  =                   36 / length of dimension 1                          
NAXIS2  =                   81 / length of dimension 2                          
PCOUNT  =                    0 / number of group parameters                     
GCOUNT  =                    1 / number of groups                               
TFIELDS =                   10 / number of table fields                         
TTYPE1  = 'moment_00'                                                           
TFORM1  = 'E       '                                                            
TTYPE2  = 'centroid_x'                                                          
TFORM2  = 'E       '                                                            
TTYPE3  = 'centroid_y'                                                          
TFORM3  = 'E       '                                                            
TTYPE4  = 'moment_20'                                                           
TFORM4  = 'E       '                                                            
TTYPE5  = 'moment_11'                                                           
TFORM5  = 'E       '                                                            
TTYPE6  = 'moment_02'                                                           
TFORM6  = 'E       '                                                            
TTYPE7  = 'peak_x  '                                                            
TFORM7  = 'I       '                                                            
TTYPE8  = 'peak_y  '                                                            
TFORM8  = 'I       '                                                            
TTYPE9  = 'peak_intensity'                                                      
TFORM9  = 'E       '                                                            
TTYPE10 = 'background'                                                          
TFORM10 = 'E       '                                                            
EXTNAME = 'TABLE1  '           / extension name                                 
CHECKSUM= 'hdRAicR1hcR8hcR8'   / HDU checksum updated 2022-09-21T22:22:08       
DATASUM = '2017643151'         / data unit checksum updated 2022-09-21T22:22:08

Questions:

Are the TABLEn HDUs required? I had thought that such files should contain the raw camera images only.
Following the review of ~~DAMD-138~~, it has been suggested that the TABLEn HDUs should contain an additional column flag. Assuming the TABLEn HDUs are necessary, this needs to be discussed and agreed.
The TABLEn HDUs appear in some of the files, but not in others, eg /data/raw/2022-09-22/agcc/agcc_20220921_2004424.fits does not contain such HDUs (see below). Why is this the case?

Filename: /data/raw/2022-09-22/agcc/agcc_20220921_2004424.fits
No.    Name      Ver    Type      Cards   Dimensions   Format
  0  PRIMARY       1 PrimaryHDU       6   ()      
  1  CAM1          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  2  CAM2          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  3  CAM3          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  4  CAM4          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  5  CAM5          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  6  CAM6          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)

PFS-JIRA

[DAMD-141] AGCC image file TABLEn HDUs need clarification