Sit on the Rail
or Fence (To). To refuse to promise your support to a party; to reserve your vote.
“In American slang, he was always sitting on the rail between Catholics and Huguenots.” —The Times.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894