(To). To attack; to fall foul of. A Gallicism. “Se laisser aller à ...”- i.e. to go without restraint.
“Thou knowest my old ward; here I [Falstaff] lay, and thus I bore my
point. Four rogues in buckram let drive at me. These four came all
a-front, and mainly thrust at me.” —
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Let Drive from Infoplease: