Real Estate Owned (Details) $ in Thousands	3 Months Ended	6 Months Ended
	Jun. 30, 2015 USD ($) property	Jun. 30, 2015 USD ($) property	Jun. 30, 2014 USD ($)	Dec. 31, 2014 property
Real Estate Owned Properties [Line Items]
Number of real estate owned properties | property	75	75		46
Number of real estate properties acquired during period | property	0	0
Number of real estate properties reclassified to REO during period | property	23	48
Gain recorded on transfer from residential whole loans to real estate owned	$ 309	$ 594
Residential Whole Loans acquired through foreclosure ordered in lieu	$ 7,600	$ 7,600
Number of REO properties sold during period | property	14	19
Proceeds from sale of real estate owned	$ 1,400	$ 2,000
Loss on sales of real estate owned	204	231
Real Estate Owned [Roll Forward]
Balance at beginning of period	8,333	5,492
Adjustments to record at lower of cost or fair value	(1,379)	(1,379)
Transfer from residential whole loans	3,554	7,002	$ 0
Disposals	(1,651)	(2,258)
Balance at end of period	8,857	8,857
Estimated Fair Value
Real Estate Owned Properties [Line Items]
Residential Whole Loans held at fair value under foreclosure proceedings	108,100	108,100
Real Estate Owned [Roll Forward]
Transfer from residential whole loans	3,600	7,000
Carrying Value
Real Estate Owned Properties [Line Items]
Residential Whole Loans held at fair value under foreclosure proceedings	$ 13,800	$ 13,800