What are the best practices for floating-point comparisons in Matlab?

I think it’s most likely going to have to be a function you write yourself. I use three things pretty constantly for running computational vector tests so to speak:

Maximum absolute error

return max(abs(result(:) - expected(:))) < tolerance

This calculates maximum absolute error point-wise and tells you whether that’s less than some tolerance.

Maximum excessive error count

return sum( (abs(result(:) - expected(:))) < tolerance )

This returns the number of points that fall outside your tolerance range. It’s also easy to modify to return percentage.

Root mean squared error

return norm(result(:) - expected(:)) < rmsTolerance

Since these and many other criteria exist for comparing arrays of floats, I would suggest writing a function which would accept the calculation result, the expected result, the tolerance and the comparison method. This way you can make your checks very compact, and it’s going to be much less ugly than trying to explain what it is that you’re doing in comments.

Leave a Comment