Parent Company Only Condensed Financial Statements - Condensed Statements of Operations (Details) - USD ($) $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2015	Sep. 30, 2015	Jun. 30, 2015	Mar. 31, 2015	Dec. 31, 2014	Sep. 30, 2014	Jun. 30, 2014	Mar. 31, 2014	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Dividends from subsidiaries									$ 141	$ 273	$ 364
Interest expense-subordinated debentures									1,248	1,322	3,019
Interest expense-notes payable	$ 3,017	$ 3,174	$ 3,072	$ 3,106	$ 3,569	$ 3,592	$ 3,567	$ 3,658	12,369	14,386	18,137
Income tax benefit	(5,445)	(4,722)	(4,762)	(5,022)	(2,812)	(4,388)	(3,664)	(3,007)	(19,951)	(13,871)	(16,976)
Net income	$ 10,679	$ 9,709	$ 8,716	$ 9,346	$ 5,967	$ 8,198	$ 7,160	$ 5,848	38,450	27,173	33,104
Total comprehensive income									36,987	33,234	20,934
Parent [Member]
Dividends from subsidiaries									10,000	10,000	10,000
Other									249	225	256
Total income									10,249	10,225	10,256
Interest expense-subordinated debentures									1,248	1,322	2,884
Interest expense-notes payable									144	193	396
Other expenses									3,823	4,402	5,142
Total expenses									5,215	5,917	8,422
Income before taxes and equity in undistributed earnings of subsidiaries									5,034	4,308	1,834
Income tax benefit									2,118	2,305	3,394
Net income									7,152	6,613	5,228
Equity in undistributed earnings of subsidiaries									31,298	20,560	27,876
Total comprehensive income									$ 38,450	$ 27,173	$ 33,104