Nose Out of Joint
To put one's nose out of joint is to supplant a person in another's good graces. To put another person's nose where yours is now. There is a good French locution, “Lui couper l'herbe sous le picd.” (In Latin, “Aliquem de jure suo dejicere.” Sometimes it means to humiliate a conceited person.
“Fearing now least this wench which is brought over hither should put your nose out the joynt, comining betweene home and you.” —Terence in English (1614).
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Nose Out of Joint from Infoplease: