An exclamation signifying what you say is not worth attention. To fiddle about is to waste time, fiddling. A fiddlestick is the instrument used in fiddling, hence the fiddlestick is even less than the fiddle.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Fiddlesticks from Infoplease: