Floating Point & Quadratics
2024-06-13 23:50:11.700826+02 by Dan Lyke 0 comments
RT Robin Green @fatlimey@mastodon.gamedev.place
Fascinating paper on solving quadratics using floating point.
You may have heard the textbook equation has problems in floating point when b^2-4ac suffers cancellation, you may know the "citardauq" method (quadratic backwards), you may know how to use copysign(b), but the analysis doesn't stop there culminating with formal proofs by Boldo that only arrived in 2009.
Watch in horror are your favorite scientific libs stumble and fall, some even at the first hurdle.