Borrowings - Summary of Other Borrowings (Details) - USD ($) $ in Thousands	Dec. 31, 2019	Mar. 31, 2019	Dec. 31, 2018
Debt Disclosure [Abstract]
FHLB advances	$ 811		$ 879
Serviced GNMA loans eligible for repurchase	57,062		61,564
Finance lease liabilities	9,520	$ 11,200
Other	18,003		17,442
Total other borrowings	$ 85,396		$ 79,885