Condensed Financial Information - Parent Company - Income Statements (Details) - USD ($) $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2016	Sep. 30, 2016	Jun. 30, 2016	Mar. 31, 2016	Dec. 31, 2015	Sep. 30, 2015	Jun. 30, 2015	Mar. 31, 2015	Dec. 31, 2016	Dec. 31, 2015
Condensed Income Statements, Captions [Line Items]
Interest income	$ 7,985	$ 7,928	$ 7,862	$ 7,913	$ 7,678	$ 7,336	$ 7,007	$ 6,734	$ 31,688	$ 28,755
Other income									12,746	12,428
Interest expense									2,702	2,451
Other expense									31,514	33,239
Income tax expense (benefit)									3,602	(37,484)
Net income	$ 2,215	$ 1,055	$ 2,128	$ 918	$ 38,594	$ 1,088	$ 1,053	$ 1,867	6,316	42,602
Preferred stock dividends									329	1,484
Discount on redemption of preferred stock									0	(13,668)
Net income for common stockholders									5,987	54,786
Parent Company
Condensed Income Statements, Captions [Line Items]
Dividends from subsidiary									0	0
Interest income									16	16
Other income									1,109	1,754
Interest expense									563	645
Other expense									693	1,055
Income tax expense (benefit)									(51)	(6,068)
Equity in undistributed earnings of subsidiaries									6,396	36,464
Net income									6,316	42,602
Preferred stock dividends									0	1,484
Discount on redemption of preferred stock									0	(13,668)
Net income for common stockholders									$ 6,316	$ 54,786