[DAMD-141] AGCC image file TABLEn HDUs need clarification Created: 13/Nov/22  Updated: 18/May/23

Status: Open
Project: Data Model
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Normal
Reporter: hassan Assignee: Yoshida, Hiroshige
Resolution: Unresolved Votes: 0
Labels: EngRun
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Relates
relates to DAMD-138 Add AGCC filename format Done

 Description   

For the Dec 2022 run:

Following DAMD-138, a few things about the content of the AGCC image files need clarifying.

Looking at Sep 2022 data, in addition to the raw camera images, there are present in some of the files TABLEn HDUs that provide detection information:

Filename: /data/raw/2022-09-22/agcc/agcc_20220921_2222058.fits
No.    Name      Ver    Type      Cards   Dimensions   Format
  0  PRIMARY       1 PrimaryHDU       6   ()      
  1  CAM1          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  2  CAM2          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  3  CAM3          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  4  CAM4          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  5  CAM5          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  6  CAM6          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  7  TABLE1        1 BinTableHDU     31   81R x 10C   [E, E, E, E, E, E, I, I, E, E]   
  8  TABLE2        1 BinTableHDU     31   60R x 10C   [E, E, E, E, E, E, I, I, E, E]   
  9  TABLE3        1 BinTableHDU     31   47R x 10C   [E, E, E, E, E, E, I, I, E, E]   
 10  TABLE4        1 BinTableHDU     31   60R x 10C   [E, E, E, E, E, E, I, I, E, E]   
 11  TABLE5        1 BinTableHDU     31   68R x 10C   [E, E, E, E, E, E, I, I, E, E]   
 12  TABLE6        1 BinTableHDU     31   60R x 10C   [E, E, E, E, E, E, I, I, E, E]
XTENSION= 'BINTABLE'           / binary table extension                         
BITPIX  =                    8 / array data type                                
NAXIS   =                    2 / number of array dimensions                     
NAXIS1  =                   36 / length of dimension 1                          
NAXIS2  =                   81 / length of dimension 2                          
PCOUNT  =                    0 / number of group parameters                     
GCOUNT  =                    1 / number of groups                               
TFIELDS =                   10 / number of table fields                         
TTYPE1  = 'moment_00'                                                           
TFORM1  = 'E       '                                                            
TTYPE2  = 'centroid_x'                                                          
TFORM2  = 'E       '                                                            
TTYPE3  = 'centroid_y'                                                          
TFORM3  = 'E       '                                                            
TTYPE4  = 'moment_20'                                                           
TFORM4  = 'E       '                                                            
TTYPE5  = 'moment_11'                                                           
TFORM5  = 'E       '                                                            
TTYPE6  = 'moment_02'                                                           
TFORM6  = 'E       '                                                            
TTYPE7  = 'peak_x  '                                                            
TFORM7  = 'I       '                                                            
TTYPE8  = 'peak_y  '                                                            
TFORM8  = 'I       '                                                            
TTYPE9  = 'peak_intensity'                                                      
TFORM9  = 'E       '                                                            
TTYPE10 = 'background'                                                          
TFORM10 = 'E       '                                                            
EXTNAME = 'TABLE1  '           / extension name                                 
CHECKSUM= 'hdRAicR1hcR8hcR8'   / HDU checksum updated 2022-09-21T22:22:08       
DATASUM = '2017643151'         / data unit checksum updated 2022-09-21T22:22:08 

Questions:

  1. Are the TABLEn HDUs required? I had thought that such files should contain the raw camera images only.
  2. Following the review of DAMD-138, it has been suggested that the TABLEn HDUs should contain an additional column flag. Assuming the TABLEn HDUs are necessary, this needs to be discussed and agreed.
  3. The TABLEn HDUs appear in some of the files, but not in others, eg /data/raw/2022-09-22/agcc/agcc_20220921_2004424.fits does not contain such HDUs (see below). Why is this the case?
Filename: /data/raw/2022-09-22/agcc/agcc_20220921_2004424.fits
No.    Name      Ver    Type      Cards   Dimensions   Format
  0  PRIMARY       1 PrimaryHDU       6   ()      
  1  CAM1          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  2  CAM2          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  3  CAM3          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  4  CAM4          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  5  CAM5          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16)   
  6  CAM6          1 ImageHDU        22   (1072, 1033)   int16 (rescales to uint16) 

Generated at Sat Feb 10 15:34:41 JST 2024 using Jira 8.3.4#803005-sha1:1f96e09b3c60279a408a2ae47be3c745f571388b.