Fair Value of Financial Instruments - Assets Measured at Fair Value on a Nonrecurring Basis (Details) - Fair Value, Measurements, Nonrecurring - USD ($) $ in Thousands	Dec. 31, 2015	Dec. 31, 2014
Residential Mortgage Loans Held In Securitization Trusts Impaired Loans
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Residential Mortgage loans held in securitization trusts – impaired loans (net)	$ 8,976	$ 9,323
Residential Mortgage Loans Held In Securitization Trusts Impaired Loans | Level 1
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Residential Mortgage loans held in securitization trusts – impaired loans (net)	0	0
Residential Mortgage Loans Held In Securitization Trusts Impaired Loans | Level 2
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Residential Mortgage loans held in securitization trusts – impaired loans (net)	0	0
Residential Mortgage Loans Held In Securitization Trusts Impaired Loans | Level 3
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Residential Mortgage loans held in securitization trusts – impaired loans (net)	8,976	9,323
Real Estate Owned Held In Residential Securitization Trusts
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Real estate owned held in residential securitization trusts	411	965
Real Estate Owned Held In Residential Securitization Trusts | Level 1
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Real estate owned held in residential securitization trusts	0	0
Real Estate Owned Held In Residential Securitization Trusts | Level 2
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Real estate owned held in residential securitization trusts	0	0
Real Estate Owned Held In Residential Securitization Trusts | Level 3
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Real estate owned held in residential securitization trusts	$ 411	$ 965