That odour and filth which accumulates on things and in places not used.
Then from the butchers we bought lamb and sheepe. Beer from the alehouse, and a broome to sweepe Our cottage, that for want of use was musty, And most extremely rusty-fusty dusty.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Rusty-Fusty from Infoplease: