Business Segments - Segment Reporting (Details) $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2018 USD ($)	Sep. 30, 2018 USD ($)	Jun. 30, 2018 USD ($)	Mar. 31, 2018 USD ($)	Dec. 31, 2017 USD ($)	Sep. 30, 2017 USD ($)	Jun. 30, 2017 USD ($)	Mar. 31, 2017 USD ($)	Dec. 31, 2018 USD ($) segment	Dec. 31, 2017 USD ($)	Dec. 31, 2016 USD ($)
Business Segments
Number of Operating Segments | segment									3
Revenues:
Interest income	$ 23,462	$ 23,691	$ 22,651	$ 22,744	$ 22,446	$ 22,703	$ 22,423	$ 22,021	$ 92,548	$ 89,593	$ 89,439
Gains on sales of loans									7,841	8,553	8,120
Other noninterest income									17,917	18,679	17,927
Total operating income									118,306	116,825	115,486
Expenses:
Provision for loan losses									11,006	16,435	18,040
Interest expense									11,027	9,601	8,968
Salaries and employee benefits									42,003	43,597	42,345
Other noninterest expenses									31,729	29,226	28,215
Total operating expenses									95,765	98,859	97,568
Income (loss) before income taxes	4,858	6,441	6,467	4,775	4,079	4,248	5,987	3,652	22,541	17,966	17,918
Income tax expense (benefit)									4,521	11,394	4,459
Net income	3,957	$ 5,101	$ 5,070	$ 3,892	(3,315)	$ 3,017	$ 4,139	$ 2,731	18,020	6,572	13,459
Total assets	1,521,411				1,509,056				1,521,411	1,509,056	1,451,992
Goodwill	14,425				14,425				14,425	14,425	14,425
Capital expenditures									3,374	4,180	2,708
Other
Revenues:
Interest income									6	1	2
Other noninterest income									2,135	1,905	1,273
Total operating income									2,141	1,906	1,275
Expenses:
Interest expense									1,152	1,151	1,143
Salaries and employee benefits									2,141	1,948	1,546
Other noninterest expenses									650	669	530
Total operating expenses									3,943	3,768	3,219
Income (loss) before income taxes									(1,802)	(1,862)	(1,944)
Income tax expense (benefit)									(594)	(137)	(969)
Net income									(1,208)	(1,725)	(975)
Total assets	5,055				(604)				5,055	(604)	6,005
Capital expenditures									4	14	42
Operating Segments | Retail Banking
Revenues:
Interest income									55,019	49,564	46,071
Other noninterest income									11,029	11,126	11,820
Total operating income									66,048	60,690	57,891
Expenses:
Provision for loan losses									100	200
Interest expense									6,842	6,076	5,790
Salaries and employee benefits									26,355	25,757	25,033
Other noninterest expenses									20,160	17,951	17,433
Total operating expenses									53,457	49,984	48,256
Income (loss) before income taxes									12,591	10,706	9,635
Income tax expense (benefit)									1,958	5,727	1,425
Net income									10,633	4,979	8,210
Total assets	1,357,788				1,341,879				1,357,788	1,341,879	1,290,733
Goodwill	3,702				3,702				3,702	3,702	3,702
Capital expenditures									3,178	3,524	1,992
Operating Segments | Mortgage Banking
Revenues:
Interest income									2,018	1,660	1,689
Gains on sales of loans									7,841	8,553	8,120
Other noninterest income									4,015	4,653	3,913
Total operating income									13,874	14,866	13,722
Expenses:
Interest expense									904	587	435
Salaries and employee benefits									5,007	6,503	5,664
Other noninterest expenses									5,363	5,185	4,815
Total operating expenses									11,274	12,275	10,914
Income (loss) before income taxes									2,600	2,591	2,808
Income tax expense (benefit)									697	1,606	1,121
Net income									1,903	985	1,687
Total assets	56,101				69,537				56,101	69,537	65,351
Capital expenditures									133	410	314
Operating Segments | Consumer Finance
Revenues:
Interest income									42,789	44,745	47,150
Other noninterest income									738	995	921
Total operating income									43,527	45,740	48,071
Expenses:
Provision for loan losses									10,906	16,235	18,040
Interest expense									9,413	8,164	7,073
Salaries and employee benefits									8,500	9,389	10,102
Other noninterest expenses									5,556	5,421	5,437
Total operating expenses									34,375	39,209	40,652
Income (loss) before income taxes									9,152	6,531	7,419
Income tax expense (benefit)									2,460	4,198	2,882
Net income									6,692	2,333	4,537
Total assets	297,552				292,438				297,552	292,438	306,012
Goodwill	10,723				10,723				10,723	10,723	10,723
Capital expenditures									59	232	360
Eliminations
Revenues:
Interest income									(7,284)	(6,377)	(5,473)
Total operating income									(7,284)	(6,377)	(5,473)
Expenses:
Interest expense									(7,284)	(6,377)	(5,473)
Total operating expenses									(7,284)	(6,377)	(5,473)
Total assets	$ (195,085)				$ (194,194)				$ (195,085)	$ (194,194)	$ (216,109)