Brewer's: Loose Fish
(A). A dissipated man. We also speak of a “queer fish,” and the word “fishy” means of very doubtful character. A loose fish is one that has made its way out of the net; and applied to man it means one who has thrown off moral restraint.
Source: Dictionary of Phrase and Fable, E. Cobham Brewer, 1894