Derivative Financial Instruments - Offsetting of Derivative Assets - Offsetting of Derivative and Financial Liabilities (Details) - USD ($) $ in Thousands	6 Months Ended	12 Months Ended
	Jun. 30, 2020	Dec. 31, 2019
Derivatives: Subject to master netting arrangements:
Gross amounts of recognized liabilities	$ 113,557	$ 37,085
Netting	(93,794)	(16,616)
Net amounts of liabilities presented in the balance sheet	19,763	20,469
Total
Gross amounts of recognized liabilities	114,948	38,946
Net amounts of liabilities presented in the consolidated balance sheet	21,154	22,330
Mortgage loans sold under agreements to repurchase
Net amounts of liabilities presented in the consolidated balance sheet	3,769,495	4,141,680
Debt Issuance Costs
Debt issuance costs, gross	(10,180)	(627)
Debt issuance costs	(10,180)	(627)
Debt issuance costs	(10,180)	(627)
Gross amounts of recognized liabilities	3,759,315	4,141,053
Net amount of liabilities in the consolidated balance sheet	3,759,315	4,141,053
Total
Gross amounts of recognized liabilities	3,874,263	4,179,999
Gross amounts offset in the consolidated balance sheet	(93,794)	(16,616)
Net amounts of liabilities presented in the consolidated balance sheet	3,790,649	4,164,010
Net amount of liabilities in the consolidated balance sheet	21,154	22,330
Receivable from Counterparties
Total
Net amounts of liabilities presented in the consolidated balance sheet	3,780,469	4,163,383
Assets sold under agreements to repurchase
Mortgage loans sold under agreements to repurchase
Gross amounts of recognized liabilities	3,769,495	4,141,680
Net amounts of liabilities presented in the consolidated balance sheet	3,769,495	4,141,680
Forward contracts | Purchases
Derivatives: Subject to master netting arrangements:
Gross amounts of recognized liabilities	4,184	19,040
Net amounts of liabilities presented in the balance sheet	4,184	19,040
Total
Gross amounts of recognized liabilities	4,184	19,040
Forward contracts | Sales
Derivatives: Subject to master netting arrangements:
Gross amounts of recognized liabilities	109,371	18,045
Net amounts of liabilities presented in the balance sheet	109,371	18,045
Total
Gross amounts of recognized liabilities	109,371	18,045
Interest rate lock commitments
Derivatives not subject to master netting arrangements
Gross amounts of recognized liabilities	1,391	1,861
Total
Net amounts of liabilities presented in the consolidated balance sheet	1,391	1,861
Net amount of liabilities in the consolidated balance sheet	1,391	$ 1,861
MBS put options
Derivatives: Subject to master netting arrangements:
Gross amounts of recognized liabilities	2
Net amounts of liabilities presented in the balance sheet	2
Total
Gross amounts of recognized liabilities	$ 2