It sounds like your handlebars may be bent or the perch may be rotated. Do you have handlebar raisers installed?
Try measure each side to ground, while the bike is held upright and the front wheel pointing forward, to test for a slightlty bent handlebar.
If I recall, there is a locating pin under each perch cluster, that fits into a locating hole in the handlebars. A trick from the off-road, is to wrap plumbers tape under each perch, to allow for the perch cluster to move if the bike takes a nap. This lessens possible damage to the perch cluster, mirrors and levers.