Parent Company Only Condensed Financial Information - Statements of Cash Flows (Details) - USD ($) $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2015	Sep. 30, 2015	Jun. 30, 2015	Mar. 31, 2015	Dec. 31, 2014	Sep. 30, 2014	Jun. 30, 2014	Mar. 31, 2014	Dec. 31, 2015	Dec. 31, 2014
Cash flows from operating activities
Net income (loss)	$ 38,594	$ 1,088	$ 1,053	$ 1,867	$ (6,016)	$ 573	$ 374	$ 558	$ 42,602	$ (4,511)
Adjustments to reconcile net income (loss) to net cash provided by operating activities
Share based compensation									461	0
Gain on extinguishment of debt									(1,750)	0
(Increase) decrease in other assets									338	(1,108)
Increase (decrease) in other liabilities									(3,624)	1,138
Net cash (used in) provided by operating activities									6,466	6,336
Cash flows from investing activities
Net cash (used in) provided by investing activities									(135,967)	33,186
Cash flows from financing activities
Repayment of Notes Payable									(8,500)	0
Purchase of Tarp Warrants									0	(2)
Net proceeds from the issuance of Common Stock									68,248	0
Purchase of Treasury Stock									0	(1,255)
Redemption of Series A Convertible Preferred Stock									0	(500)
Redemption of Series C Cumulative Perpetual Preferred Stock									(19,000)	0
Issuance of Series D Non-Cumulative Perpetual Preferred Stock									0	2,636
Dividends paid on preferred stock									(478)	(881)
Net cash provided by (used in) financing activities									107,989	(61,103)
Cash and cash equivalents									(21,512)	(21,581)
Beginning of period				49,167				70,748	49,167	70,748
End of period	27,655				49,167				27,655	49,167
Parent Company
Cash flows from operating activities
Net income (loss)									42,602	(4,511)
Adjustments to reconcile net income (loss) to net cash provided by operating activities
Undistributed (earnings) loss of subsidiary									(36,464)	3,890
Share based compensation									461	0
Gain on extinguishment of debt									(1,750)	0
(Increase) decrease in other assets									(4,271)	(1,675)
Increase (decrease) in other liabilities									(4,871)	699
Net cash (used in) provided by operating activities									(4,293)	(1,597)
Cash flows from investing activities
Capital infusion to subsidiary									(36,000)	0
Net cash (used in) provided by investing activities									(36,000)	0
Cash flows from financing activities
Repayment of Notes Payable									(8,500)	0
Purchase of Tarp Warrants									0	(2)
Net proceeds from the issuance of Common Stock									68,248	0
Purchase of Treasury Stock									0	(1,255)
Redemption of Series A Convertible Preferred Stock									0	(500)
Redemption of Series C Cumulative Perpetual Preferred Stock									(19,000)	0
Issuance of Series D Non-Cumulative Perpetual Preferred Stock									0	2,636
Dividends paid on preferred stock									(478)	(881)
Net cash provided by (used in) financing activities									40,270	(2)
Cash and cash equivalents									(23)	(1,599)
Beginning of period				$ 764				$ 2,363	764	2,363
End of period	$ 741				$ 764				$ 741	$ 764