Other Asset and Other Liabilities (Details) - USD ($) $ in Thousands	Jun. 30, 2017	Dec. 31, 2016
Other assets:
Due from servicers	$ 10,071	$ 27,029
Intangible assets	3,450	3,636
Accrued interest	5,825	5,606
Real estate accrued in settlement of loans	4,798	3,933
Deferred financing costs	2,892	3,376
Fixed assets	1,361	1,572
Prepaid taxes	4,285	1,456
Deferred tax asset	1,371	1,371
Prepaid technology expense	684	918
Prepaid insurance expense	387	899
Other	4,328	4,481
Total other assets	39,452	54,277
Other liabilities:
Accrued salaries, wages and commissions	11,212	17,450
Servicing principal and interest payable	8,765	10,664
Repair and denial reserve	6,801	6,813
Liability under subservicing agreements	2,153	6,757
Unapplied cash	2,624	6,278
Accrued interest payable	7,833	4,680
Payable to related parties	2,484	3,762
Accrued professional fees	1,201	2,880
Loan indemnification reserve	2,735	2,780
Accrued tax liability	4,067	1,996
Liability under participation agreements	1,169	1,735
Deferred tax liability	118	632
Accounts payable on liability under participation agreements	48	982
Cash held as collateral	80	80
Other	2,478	2,718
Total other liabilities	$ 53,768	$ 70,207