Business Combinations - Bargain Purchase (Details) $ / shares in Units, $ in Thousands			12 Months Ended
	Oct. 25, 2019 USD ($)	Mar. 29, 2019 USD ($) $ / shares shares	Dec. 31, 2019 USD ($)	Dec. 31, 2020 USD ($)
Aggregate consideration transferred, net of assets acquired and bargain purchase gain
Bargain purchase gain			$ 30,728
Goodwill			11,206	$ 11,206
Owens Realty Mortgage, Inc.
Aggregate consideration transferred, net of assets acquired and bargain purchase gain
FV of Net Assets Acquired		$ 210,047
ORM shares outstanding at March 29, 2019 | shares		8,482,880
Exchange ratio		1.441
Shares issued | shares		12,223,830
Closing share price | $ / shares		$ 14.67
Total consideration transferred based on value of shares issued		$ 179,324
Bargain purchase gain		$ 30,728
Acquisition related costs			6,200
Knight Capital
Aggregate consideration transferred, net of assets acquired and bargain purchase gain
Cash consideration	$ 17,500
Common stock consideration	10,290
FV of Net Assets Acquired	16,585
Net Tangible Assets	10,705
Identified Intangible Assets	5,880
Total consideration transferred based on value of shares issued	27,790
Goodwill	$ 11,205
Acquisition related costs			$ 1,500