Other Assets - Schedule of Other Assets (Details) - USD ($) $ in Thousands	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Deferred Costs, Capitalized, Prepaid, and Other Assets Disclosure [Abstract]
Investment in Low Income Housing Partnerships	$ 20,233	$ 22,862
Deferred taxes, net	9,939	10,087	$ 8,776
Bank owned life insurance	5,887	7,375
Investment in equity method investments	4,573	4,767
Accrued interest receivable	3,620	3,373
Prepaid expenses	1,230	2,217
Taxes receivable	878	1,220
Net amounts of assets and liabilities presented in the Statement of Financial Position	1,514	841
Other assets	3,900	5,020
Total	$ 51,774	$ 57,762