LEAD: Swank Inc., a jewelry and leather goods manufacturer based in Attleboro, Mass., said it had agreed to sell its Prince Gardner and Wilshire divisions to a company formed by members of Prince ...