The right-hand side of the Speaker, meaning the Ministerial benches. In the French Legislative Assembly the right meant the Monarchy men. In the National Convention the Girondists were called the right hand, because they occupied the Ministerial benches.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Right Hand from Infoplease: