You can set an annotation leader perpendicular to its associated geometrical element.
You can set as default the leader perpendicularity during the creation from the options.
See Leader Associativity To the Geometry.
You obtain this result.