To keep two faces under one hood. To be double-faced; to pretend to be very religious, and yet live an evil life.
“We never troubled the Church ... We knew we were doing what we ought not to do, and scorned to look pious, and keep two faces under one hood.” —Boldrewood: Robbery Under Arms, chap. ii.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Faces from Infoplease: