Uploaded image for project: 'Data Model'
  1. Data Model
  2. DAMD-13

Change pfsFiberTrace description to persist trace-function coefficients as double

    Details

    • Type: Story
    • Status: Won't Fix (View Workflow)
    • Priority: Major
    • Resolution: Won't Fix
    • Labels:
      None
    • Story Points:
      0.25

      Description

      As shown in PIPE2D-98, the lack of precision in the trace-function coefficients due to only persisting floats is responsible for the difference between the stored FiberTraces and the reconstructed ones. This means that we will have to change the datamodel to persist the trace-function coefficients as double values.

        Attachments

          Issue Links

            Activity

            Hide
            rhl rhl added a comment -

            Hmm, I am suspicious about needing doubles. The description of this ticket says, "As shown in PIPE2D-98", but I do not see any such demonstration in that ticket, just a comment from swinbank that this might be a problem.

            What basis functions are you using? Polynomials? What is the maximum value of the basis functions (probably 1 as I think you're normalising the range into +-1)? Is there some delicate cancellation? Please investigate why you are losing so much precision as to need doubles before implementing this ticket.

            Show
            rhl rhl added a comment - Hmm, I am suspicious about needing doubles. The description of this ticket says, "As shown in PIPE2D-98 ", but I do not see any such demonstration in that ticket, just a comment from swinbank that this might be a problem. What basis functions are you using? Polynomials? What is the maximum value of the basis functions (probably 1 as I think you're normalising the range into +-1)? Is there some delicate cancellation? Please investigate why you are losing so much precision as to need doubles before implementing this ticket.
            Hide
            swinbank swinbank added a comment -

            Obsoleted by work on PIPE2D-98.

            Show
            swinbank swinbank added a comment - Obsoleted by work on PIPE2D-98 .

              People

              • Assignee:
                Unassigned
                Reporter:
                aritter aritter
              • Votes:
                0 Vote for this issue
                Watchers:
                Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: