Only one regiment of all the British army is so called, and that is the “Loyal North Lancashire,” in two battalions, No. 47 and No. 81. It was so called in 1793, and probably had some allusion to the French revolutionists.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Loyal from Infoplease: