Investment Securities - Schedule of Amortized Cost and Fair Value by Contractual Maturity of Available-For-Sale Securities (Details) - USD ($) $ in Thousands	Mar. 31, 2017	Dec. 31, 2016
Schedule of Available-for-sale Securities [Line Items]
Amortized Cost	$ 324,148	$ 331,812
U.S. Treasury and government sponsored entities
Schedule of Available-for-sale Securities [Line Items]
Within 1 year, amortized cost	37,002
1-5 years, amortized cost	224,281
Amortized Cost	261,283	264,267
Within 1 year, fair value	36,997
1-5 years, fair value	223,638
Fair Value	$ 260,635
Within 1 year, weighted average yield	0.97%
1-5 years, weighted average yield	6.57%
Weighted Average Yield	5.78%
U.S. Agency mortgage-backed securities
Schedule of Available-for-sale Securities [Line Items]
1-5 years, amortized cost	$ 1
Amortized Cost	1	2
1-5 years, fair value	1
Fair Value	$ 1
1-5 years, weighted average yield	5.06%
Weighted Average Yield	5.06%
Corporate bonds
Schedule of Available-for-sale Securities [Line Items]
Within 1 year, amortized cost	$ 4,801
1-5 years, amortized cost	26,206
5-10 years, amortized cost	8,435
Amortized Cost	39,442	44,437
Within 1 year, fair value	4,807
1-5 years, fair value	26,443
5-10 years, fair value	8,606
Fair Value	$ 39,856
Within 1 year, weighted average yield	1.40%
1-5 years, weighted average yield	1.88%
5-10 years, weighted average yield	2.32%
Weighted Average Yield	1.92%
Preferred stock
Schedule of Available-for-sale Securities [Line Items]
Over 10 years, amortized cost	$ 5,421
Amortized Cost	5,421	$ 4,922
Over 10 years, fair value	5,578
Fair Value	$ 5,578
Over 10 years, weighted average yield	6.37%
Weighted Average Yield	6.37%