Commitments, Contingencies and Indemnifications (Details) - USD ($) $ in Thousands	Mar. 31, 2021	Dec. 31, 2020
Originated Residential Agency loans
Commitments, contingencies and indemnifications
Commitments to originate residential agency loans	$ 590,612	$ 575,600
Unfunded loan commitments
Commitments, contingencies and indemnifications
Loans, net	293,919	285,389
Loans, held for sale at fair value	$ 11,123	$ 7,809