Portfolio Loans - Summary of Past Due and Impaired Loans (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Financing Receivable, Impaired [Line Items]
Total interest income that would have been recognized under original terms on impaired loans	$ 1,137	$ 2,153	$ 1,324
Total cash received and recognized as interest income on impaired loans	307	284	643
Total interest income recognized on impaired loans still accruing	116	149	63
Non-Covered Loans
Financing Receivable, Impaired [Line Items]
Average Recorded Investment	$ 29,540	$ 15,573	$ 19,722