properly means a kitchen garden, a yard for herbs. (Saxon, ortgeard- i.e. wort-yard.) Wort enters into the names of numerous herbs, as mug-wort, liver-wort, spleen-wort, etc.
The hortyard entering [he] admires the fair And pleasant fruits.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894