Other Assets - Other (Details) - USD ($) $ in Thousands	Mar. 31, 2021	Dec. 31, 2020
Carrying value:
Deposits	$ 102,270	$ 153,054
Margin deposits	89,417	116,881
Capitalized software, net	85,371	81,434
Furniture, fixtures, equipment and building improvements, net	32,714	32,217
Real estate acquired in settlement of loans	9,616	12,158
Other	318,869	296,425
Other assets	638,257	692,169
Assets pledged to secure Obligation under capital lease:
Capitalized software, net	6,778	7,675
Furniture, fixture, equipment and building improvements, net	5,294	5,689
Assets securing capital lease	$ 114,342	$ 166,418