Investment Securities - Summary of Investment Security Carrying and Fair Value (Details) - USD ($) $ in Thousands	Jun. 30, 2017	Dec. 31, 2016
Schedule of Held-to-maturity Securities [Line Items]
Amortized Cost	$ 898	$ 899
Gross Unrealized Gains	7	23
Gross Unrealized Losses	0	0
Fair Value	905	922
Schedule of Available-for-sale Securities [Line Items]
Amortized Cost	297,141	331,812
Gross Unrealized Gains	860	520
Gross Unrealized Losses	779	1,113
Fair Value	297,222	331,219
U.S. Treasury and government sponsored entities
Schedule of Available-for-sale Securities [Line Items]
Amortized Cost	236,733	264,267
Gross Unrealized Gains	92	150
Gross Unrealized Losses	744	1,056
Fair Value	236,081	263,361
Municipal securities
Schedule of Available-for-sale Securities [Line Items]
Amortized Cost	17,346	18,184
Gross Unrealized Gains	125	26
Gross Unrealized Losses	29	53
Fair Value	17,442	18,157
U.S. Agency mortgage-backed securities
Schedule of Available-for-sale Securities [Line Items]
Amortized Cost	1	2
Gross Unrealized Gains	0	0
Gross Unrealized Losses	0	0
Fair Value	1	2
Corporate bonds
Schedule of Available-for-sale Securities [Line Items]
Amortized Cost	34,640	44,437
Gross Unrealized Gains	415	295
Gross Unrealized Losses	0	0
Fair Value	35,055	44,732
Collateralized loan obligations
Schedule of Available-for-sale Securities [Line Items]
Amortized Cost	3,000
Gross Unrealized Gains	0
Gross Unrealized Losses	0
Fair Value	3,000
Preferred stock
Schedule of Available-for-sale Securities [Line Items]
Amortized Cost	5,421	4,922
Gross Unrealized Gains	228	49
Gross Unrealized Losses	6	4
Fair Value	5,643	4,967
Municipal securities
Schedule of Held-to-maturity Securities [Line Items]
Amortized Cost	898	899
Gross Unrealized Gains	7	23
Gross Unrealized Losses	0	0
Fair Value	$ 905	$ 922