You can set the attenuation for the displacement of the handle.
The attenuation is defined in Me > Preferences > App Preferences > 3D Modeling > Styling . Fore more information, see General.
: Mouse displacement
: Real displacement
Attenuation activated