Brewer's: Long Chalk
(A) or Long Chalks He beat me by a long chalk or by long chalks. By a good deal; by many marks. The allusion is to the game of dominoes, where the notation is made by chalk on a table.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894