Other Assets (Details) - USD ($) $ in Thousands	Jun. 30, 2019	Mar. 31, 2019	Dec. 31, 2018	Jun. 30, 2018	Mar. 31, 2018	Dec. 31, 2017
Other Assets [Abstract]
REO	$ 334,069	$ 290,587	$ 249,413	$ 192,162	$ 182,940	$ 152,356
MBS and loan related receivables	98,027		130,964
Other interest earning assets	103,446		92,022
Other	72,203		55,386
Total Other Assets	$ 607,745		$ 527,785