Segment Reporting - Narrative (Details) $ in Thousands	3 Months Ended
	Mar. 31, 2018 USD ($) segment	Mar. 31, 2017 USD ($)
Segment Reporting Information [Line Items]
Number of reportable segments | segment	3
Net income (loss)	$ 2,594	$ 1,574
Net income	2,594	1,574
Operating Segments | Commercial & Retail Banking
Segment Reporting Information [Line Items]
Net income (loss)	3,561	2,487
Increase (decrease) in net interest income	971
Increase (decrease) in loan interest and fee income	949
Increase (decrease) in taxable investment securities interest	349
Increase (decrease) in tax exempt loans and securities	217
Increase (decrease) in deposit interest	392
Increase (decrease) in FHLB and other borrowings interest income	160
Increase (decrease) in noninterest income	658
Increase (decrease) on commercial swap fee income	413
Increase (decrease) in performance of interest rate cap	183
Increase (decrease) in gain on sale of portfolio loans	203
Increase (decrease) in noninterest expense	821
Increase (decrease) in salaries and emplyee benefits expense	912
Increase (decrease) in other operating expense	202
Increase (decrease) in data processing expense	(376)
Increase (decrease) in provision expense	(83)
Operating Segments | Mortgage Banking
Segment Reporting Information [Line Items]
Net income (loss)	150	$ 116
Increase (decrease) in net interest income	131
Increase (decrease) in FHLB and other borrowings interest income	423
Increase (decrease) in noninterest income	(616)
Increase (decrease) in noninterest expense	(515)
Increase (decrease) in salaries and emplyee benefits expense	(539)
Increase (decrease) in interest and fees on loans	554
Increase (decrease) in mortgage fee income	(3,000)
Increase (decrease) in derivative performance	$ 2,300
Increase (decrease) locked mortgage pipeline (percentage)	67.60%	12.80%
Increase (decrease) mortgage closed loan volume	(13.20%)
Increase (decrease) in earn out payments	$ (125)
Operating Segments | Financial Holding Company
Segment Reporting Information [Line Items]
Net income (loss)	(1,117)	$ (1,029)
Increase (decrease) in net interest income	7
Increase (decrease) in noninterest income	343
Increase (decrease) in noninterest expense	222
Increase (decrease) in salaries and emplyee benefits expense	138
Increase (decrease) in income tax expense	(202)
Increase (decrease) in gain on sale of securities	186
Increase (decrease), holding gain on available for sale securities	52
Increase (decrease), intercompany services income	105
Increase (decrease) travel, entertainment, dues, and subscriptions expense	$ 131