Parent Company Only Financial Information - Summary of Statements of Income (Loss) (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2014	Dec. 31, 2013	Dec. 31, 2012
Income
Total interest income	$ 80,262	$ 70,763	$ 73,287
Interest expense	5,355	5,557	8,478
Other expenses	9,988	9,472	9,023
Income tax benefit	4,544	(40,385)	0
Net income (loss)	5,696	51,989	(710)
Parent Company [Member]
Income
Dividends from subsidiary Bank	0	0	0
Interest/other	43	28	29
Total interest income	43	28	29
Interest expense	1,053	958	1,057
Other expenses	1,000	450	575
Loss before income tax benefit and equity in undistributed income of subsidiaries	(2,010)	(1,380)	(1,603)
Income tax benefit	(704)	(2,281)	0
Income (loss) before equity in undistributed income of subsidiaries	(1,306)	901	(1,603)
Equity in undistributed income of subsidiaries	7,002	51,088	893
Net income (loss)	$ 5,696	$ 51,989	$ (710)