Try to point at least one side of Smart Dimension to surface instead of the point to point/edge.
Surface->Surface or Surface->Point/Edge will keep "perpendicular" orientation of Smart Dimension, but if you using more locked Smart Dimensions try to use as much as you can Surface->Surface