Brewer's: Stars and Garters!
(My). An expletive, or mild kind of oath. The stars and garters of knighthood. Shakespeare makes Richard III. swear “By my George, my garter, and my crown !” (Richard III., iv. 4.)
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894