Investment Securities - Unrealized Gain (Loss) on Investments (Details) - USD ($) $ in Thousands	Jun. 30, 2016	Dec. 31, 2015
Schedule of Available-for-sale Securities [Line Items]
Less than 12 months, fair value	$ 32,558	$ 173,912
Less than 12 months, unrealized losses	87	977
More than 12 months, fair value	1,969	136
More than 12 months, unrealized losses	17	2
Fair Value	34,527	174,048
Unrealized Losses	104	979
U.S. Treasury and government sponsored entities
Schedule of Available-for-sale Securities [Line Items]
Less than 12 months, fair value	12,422	146,433
Less than 12 months, unrealized losses	3	829
More than 12 months, fair value	489	36
More than 12 months, unrealized losses	4	1
Fair Value	12,911	146,469
Unrealized Losses	7	830
Corporate bonds
Schedule of Available-for-sale Securities [Line Items]
Less than 12 months, fair value	17,421	19,874
Less than 12 months, unrealized losses	36	88
More than 12 months, fair value	0	0
More than 12 months, unrealized losses	0	0
Fair Value	17,421	19,874
Unrealized Losses	36	88
Municipal securities
Schedule of Available-for-sale Securities [Line Items]
Less than 12 months, fair value	1,209	4,454
Less than 12 months, unrealized losses	4	18
More than 12 months, fair value	1,480	0
More than 12 months, unrealized losses	13	0
Fair Value	2,689	4,454
Unrealized Losses	17	18
Mortgage-backed Securities
Schedule of Available-for-sale Securities [Line Items]
Less than 12 months, fair value		637
Less than 12 months, unrealized losses		9
More than 12 months, fair value		100
More than 12 months, unrealized losses		1
Fair Value		737
Unrealized Losses		10
Preferred stock
Schedule of Available-for-sale Securities [Line Items]
Less than 12 months, fair value	1,506	2,514
Less than 12 months, unrealized losses	44	33
More than 12 months, fair value	0	0
More than 12 months, unrealized losses	0	0
Fair Value	1,506	2,514
Unrealized Losses	$ 44	$ 33