Hi there,
I am no SEO expert by any stretch of the imagination. All i know is a badly structured navigation will make site visitors leave without finding what they’re looking for and a well structured navigation could well do the opposite.
So its more the indirect consequences of good or bad UI that should dictate the reasons to change. Simply changing the position of a link shouldn’t have any technical impact on SEO but could be good or bad for the visitor.