Programming language support for hexadecimal integers is very common. Support for hexadecimal floating point numbers is not. It’s a common…

Continue Reading# floating

## Novel and extended floating point

My first consulting project, right after I graduated college, was developing floating point algorithms for a microprocessor. It was fun…

Continue Reading## How to compute the square root of a complex number

Suppose you’re given a complex number z = x + iy and you want to find a complex number w…

Continue Reading## Accurately computing a 2×2 determinant

The most obvious way to compute the determinant of a 2×2 matrix can be numerically inaccurate. The biggest problem with…

Continue Reading## Summing an array of floating point numbers

No and no. In fact, the use of 32-bit float types is on the rise. Moving data in an out…

Continue Reading