Brewer's: Whistle Down the Wind
(To). To defame a person. The cognate phrase “blown upon” is more familiar. The idea is to whistle down the wind that the reputation of the person may be blown upon.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894