Income Taxes - Components of Deferred Assets and Liabilities (Details) - USD ($)	Dec. 31, 2016	Dec. 31, 2015
Deferred tax assets
Allowance for loan losses	$ 3,465,000	$ 3,342,000
Deferred compensation, other	108,000	74,000
Stock based expense	66,000	87,000
Net operating loss carryforwards	30,166,000	34,180,000
Securities available-for-sale	655,000	405,000
Deferred tax credits	1,068,000	823,000
OREO valuation allowance	942,000	1,059,000
Depreciation	196,000	0
Donation carryforward	0	5,000
Capital loss carryforward	0	4,000
Other	204,000	246,000
Total deferred tax assets	36,870,000	40,225,000
Deferred tax liabilities
Depreciation	0	(58,000)
Adjustments arising from acquisitions	(30,000)	(146,000)
Mortgage servicing rights	(791,000)	(828,000)
Federal Home Loan Bank dividend received in stock	(450,000)	(450,000)
Deferred loan fees & costs	(385,000)	(399,000)
Prepaid expenses	(179,000)	(164,000)
Total deferred tax liabilities	(1,835,000)	(2,045,000)
Valuation allowance	0	0
Net deferred tax assets	$ 35,035,000	$ 38,180,000