• Scrubbles
    link
    fedilink
    English
    236 days ago

    Ah floating point math. Works fine for 90% of use cases, until it doesn’t.

    • @[email protected]
      link
      fedilink
      English
      116 days ago

      Better calculators just use floating point math with a few tricks on top to pretend it isn’t floating point math.

    • @[email protected]
      link
      fedilink
      66 days ago

      Weirdly though it wasn’t remotely close to the right answer so I don’t think it was floating point malarkey. I always assumed some defect but I guess we’ll never know.now I wish I had kept it so I could have sent it to Matt Parker for his calculator reviews