Cautiously, with faltering steps. The Scotch phrase, “gang that gate,” and the Anglo-Saxon gangende (going), applied to an army looking out for ambuscades, would furnish the adverb gangendelic; Swedish, gingla, to go gently.
“Gingerly, as if treading upon eggs. Cuddie began to ascend the
well-known pass.” —
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Gingerly from Infoplease: