So called from La Bayonette, a lower ridge of the Montage d'Arrhune. A Basque regiment, early in the seventeenth century, running short of powder, stuck their knives into their muskets; and charged the Spaniards with success. Some derive this word from Bayonne.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Bayonet from Infoplease: