I had a horse that acted a bit like yours once. it
turned out that he was used to center fire rigging, & the girth in the usual
place was galling him a bit. I would look to your saddle fit with you
mounted & moving. Ask a friend to help you, & remember- hills
& curves on trail make a large difference in what's going on. Good
Luck ! - Heidi Helly