So called in honour of the Virgin Mary, and hence the introduction of marigold windows in lady chapels. (See Marygold.)
This riddle, Cuddy, if thou canst, explain ... What flower is that which bears the Virgin's name, The richest metal added to the same?
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Marigold from Infoplease: