ASSET SALE AND SUBSIDIARY SALE TRANSACTIONS - Additional Information (Details)					3 Months Ended		9 Months Ended
	Sep. 28, 2016 USD ($)	May 05, 2016 USD ($)	Sep. 25, 2015 USD ($) Branch	Jun. 25, 2015 USD ($)	Sep. 30, 2016 USD ($)	Sep. 30, 2015 USD ($)	Sep. 30, 2016 USD ($)	Sep. 30, 2015 USD ($)
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Proceeds from sale of property							$ 0	$ 52,192,000
Gain on sale of building					$ 0	$ 0	0	9,919,000
Gain on sale of branches							0	163,000
Proceeds from sale of loans							276,264,000	389,944,000
Net gain on sale of loans					11,063,000	9,737,000	15,405,000	22,047,000
Stated interest rate		10.00%
Note receivable		$ 5,000,000
Disposal Group, Disposed of by Sale, Not Discontinued Operations | The Palisades Group
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Gain on sale of branches		$ 3,700,000			3,694,000
Fair value of The Note					$ 2,370,000		$ 2,370,000
Gain on notes receivable	$ 2,800,000
Americas United Bank
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Number of branches sold | Branch			2
Deposits held for sale			$ 46,900,000
Proceeds from sale of loans			40,200,000
Other Income | Americas United Bank
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Gain on sale of branches						$ 163,000
Net Gain on Sale of Loans | Americas United Bank
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Net gain on sale of loans			$ 644,000
Building
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Proceeds from sale of property				$ 52,300,000
Gain on sale of building				9,900,000
Carrying value of property				$ 42,300,000
Building | Professional Fees and All Other Expenses
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Selling costs								$ 2,300,000