Other Asset and Other Liabilities - Real Estate Acquired in Settlement of Loans (Details) - USD ($) $ in Thousands	Jun. 30, 2017	Dec. 31, 2016
Real estate accrued in settlement of loans
Real estate accrued in settlement of loans	$ 4,798	$ 3,933
Valuation allowance for real estate acquired in settlement of loans	8,200	6,900
Loan indemnification reserve
Loan Indemnification Reserve	2,735	2,780
NORTH CAROLINA
Real estate accrued in settlement of loans
Real estate accrued in settlement of loans	1,850	1,850
FLORIDA
Real estate accrued in settlement of loans
Real estate accrued in settlement of loans	1,332	1,320
ILLINOIS
Real estate accrued in settlement of loans
Real estate accrued in settlement of loans	1,249	19
TEXAS
Real estate accrued in settlement of loans
Real estate accrued in settlement of loans	108	108
Other
Real estate accrued in settlement of loans
Real estate accrued in settlement of loans	$ 259	$ 636