Income Tax - Narrative (Details) - USD ($)	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018
Valuation Allowance [Line Items]
Decrease in net deferred tax assets	$ 13,121,000
Increase in net deferred tax liability for unrealized gains (losses) on available for sale securities	12,019,000
Increase due to accounting for loans	1,902,000
Deferred tax asset increase from deferred compensation	2,336,000
Additional paid-in capital	1,054,997,000	$ 840,052,000
Unrecorded deferred tax liability	5,308,000
CFS
Valuation Allowance [Line Items]
Additional paid-in capital	13,393,000
Ameriana
Valuation Allowance [Line Items]
Additional paid-in capital	11,883,000
State and Local Jurisdiction
Valuation Allowance [Line Items]
State tax loss carryforward	28,354,000
State deferred tax assets	$ 3,719,000