If two handles are next to each other or overlap it is possible for the
mouse-cursor to move from one handle to the other without a
mouse-move-event being fired where isHoveringHandle is false.
Thus, the valid and connecting css-classes were not removed from the
handle.
This commit fixes this.