The upper ten thousand, or “the upper ten.” When persons are in “society,” they are on the visiting lists of the fashionable social leaders. The “society” of a district are the great panjandrums thereof.
“All the society of the district were present at the prince's ball.” —Newspaper paragraph, December, 1885.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894
More on Society from Infoplease: