Scientific computing, math & more

Posts 1 - 10 of 27

Results for: Precision

Round, With Tie Breakers, A Prototype

In February and March I published three blog posts about an enhancement request for MATLAB concerning tie breakers with theroundfunction, including the ability to round ties to even.Round One,Round TwoandRound Three. Since then, a group of us at MathWorks, organized by my colleague (and academic great-great-grand-descendant) Heiko Weichelt, have been considering the request. We had a virtual design review recently. This post describes a prototype incorporating the features that were discussed at that review....read more >>

Experiments with Variable Format Half Precision

For the past month I have been working with the variable format 16-bit floating point arithmetic that I describedin this post. It has been frustrating work. I have found that the limited precision and limited range of half precision make it barely usable for the kind of experiments with matrix computation that I like to do. In this post I will describe a few of these experiments....read more >>

Posts 1 - 10 of 27