[PIPE2D-745] detectorMap can have very large file size Created: 02/Mar/21 Updated: 29/Jan/22 Resolved: 03/Mar/21 |
|
| Status: | Done |
| Project: | DRP 2-D Pipeline |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Story | Priority: | Normal |
| Reporter: | price | Assignee: | price |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Reviewers: | hassan |
| Description |
|
Neven and RHL have noticed that some detectorMaps have a very large file size (>100 MB). I suspect that these are from bootstrap. In addition, add some provenance to the detectorMaps from bootstrap and reduceArc |
| Comments |
| Comment by price [ 02/Mar/21 ] |
|
The SplinedDetectorMap produced by the bootstrap process is now much smaller, and contains some basic provenance in the header: HISTORY bootstrap on 2021-03-01T18:21:01.223652 with arc=45744 In the process, discovered a bug in SplinedDetectorMap from not updating a cache. |
| Comment by hassan [ 03/Mar/21 ] |
|
What is the rough size of the resultant SplinedDetectorMap following the fix? |
| Comment by price [ 03/Mar/21 ] |
|
About 2MB. price@PU-C02F30LBMD6V:~/pfs/drp_pfs_data/detectorMap (tickets/PIPE2D-745=) $ ls -l total 854800 -rw-rw-r-- 1 price staff 465 Jan 25 13:34 README.txt -rw-rw-r-- 1 price staff 80205120 Jan 25 13:35 detectorMap-2017Sep-r1.fits -rw-rw-r-- 1 price staff 80205120 Jan 25 13:35 detectorMap-2019Apr-r1.fits -rw-rw-r-- 1 price staff 80205120 Jan 25 13:35 detectorMap-2019Jul-b1.fits -rw-rw-r-- 1 price staff 80205120 Jan 25 13:35 detectorMap-2019Jul-r1.fits -rw-rw-r-- 1 price staff 80205120 Jan 25 13:35 detectorMap-2020Apr-m1.fits -rw-rw-r-- 1 price staff 2134080 Feb 4 16:17 detectorMap-sim-b1.fits -rw-rw-r-- 1 price staff 2134080 Feb 4 16:17 detectorMap-sim-b2.fits -rw-rw-r-- 1 price staff 2128320 Feb 4 16:17 detectorMap-sim-b3.fits -rw-rw-r-- 1 price staff 2128320 Feb 4 16:17 detectorMap-sim-b4.fits -rw-rw-r-- 1 price staff 1932480 Feb 4 16:17 detectorMap-sim-m1.fits -rw-rw-r-- 1 price staff 1932480 Feb 4 16:17 detectorMap-sim-m2.fits -rw-rw-r-- 1 price staff 1926720 Feb 4 16:17 detectorMap-sim-m3.fits -rw-rw-r-- 1 price staff 1926720 Feb 4 16:17 detectorMap-sim-m4.fits -rw-rw-r-- 1 price staff 1961280 Feb 4 16:17 detectorMap-sim-n1.fits -rw-rw-r-- 1 price staff 1961280 Feb 4 16:17 detectorMap-sim-n2.fits -rw-rw-r-- 1 price staff 1955520 Feb 4 16:17 detectorMap-sim-n3.fits -rw-rw-r-- 1 price staff 1955520 Feb 4 16:17 detectorMap-sim-n4.fits -rw-rw-r-- 1 price staff 2076480 Feb 4 16:17 detectorMap-sim-r1.fits -rw-rw-r-- 1 price staff 2076480 Feb 4 16:17 detectorMap-sim-r2.fits -rw-rw-r-- 1 price staff 2070720 Feb 4 16:17 detectorMap-sim-r3.fits -rw-rw-r-- 1 price staff 2070720 Feb 4 16:17 detectorMap-sim-r4.fits -rw-rw-r-- 1 price staff 2134080 Mar 1 18:21 pfsDetectorMap-045744-b1.fits -rw-rw-r-- 1 price staff 2076480 Mar 1 18:21 pfsDetectorMap-045744-r1.fits |
| Comment by hassan [ 03/Mar/21 ] |
|
Thanks - I realized you had committed the detector maps very shortly after sending my comment. |
| Comment by price [ 03/Mar/21 ] |
|
Merged to master. |