Other Investments - Servicing Advance Investments (Details) - Residential Loans - USD ($) $ in Thousands	Dec. 31, 2020	Dec. 31, 2019
Investment [Line Items]
Principal and interest advances	$ 110,923	$ 15,081
Escrow advances (taxes and insurance advances)	79,279	96,732
Corporate advances	27,454	39,769
Total Servicer Advance Receivables	$ 217,656	$ 151,582

Fair value of an asset representing net future revenue from contractually specified servicing fees, late charges, and other ancillary revenues, in excess of future costs related to servicing arrangements.

Reference 1: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 860
-SubTopic 50
-Section 45
-Paragraph 2
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=6469459&loc=d3e122501-111745

Reference 2: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 860
-SubTopic 50
-Section 45
-Paragraph 1
-URI http://asc.fasb.org/extlink&oid=6469459&loc=d3e122492-111745

Reference 3: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 860
-SubTopic 50
-Section 50
-Paragraph 3
-Subparagraph (a)(1)
-URI http://asc.fasb.org/extlink&oid=116651436&loc=d3e122625-111746

Reference 4: http://www.xbrl.org/2003/role/disclosureRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 860
-SubTopic 50
-Section 45
-Paragraph 2
-Subparagraph (a)
-URI http://asc.fasb.org/extlink&oid=6469459&loc=d3e122501-111745

Name:	us-gaap_ServicingAssetAtFairValueAmount
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant