Long-Term Debt - Details of Debentures (Details) $ in Thousands	Dec. 31, 2019 USD ($)
PHC Statutory Trust I
Debentures details
Principal Amount	$ 20,619
Interest Rate	4.75%
Amount Included in Tier 1 Capital	$ 20,000
PHC Statutory Trust II
Debentures details
Principal Amount	$ 31,959
Interest Rate	3.76%
Amount Included in Tier 1 Capital	$ 31,000
Capital Bancorp Capital Trust I
Debentures details
Principal Amount	$ 12,372
Interest Rate	3.46%
Amount Included in Tier 1 Capital	$ 12,000
First M&F Statutory Trust I
Debentures details
Principal Amount	$ 30,928
Interest Rate	3.22%
Amount Included in Tier 1 Capital	$ 21,098
Brand Group Holdings Statutory Trust I
Debentures details
Principal Amount	$ 10,310
Interest Rate	3.99%
Amount Included in Tier 1 Capital	$ 9,108
Brand Group Holdings Statutory Trust II
Debentures details
Principal Amount	$ 5,155
Interest Rate	4.89%
Amount Included in Tier 1 Capital	$ 5,058
Brand Group Holdings Statutory Trust III
Debentures details
Principal Amount	$ 5,155
Interest Rate	4.89%
Amount Included in Tier 1 Capital	$ 5,058
Brand Group Holdings Statutory Trust IV
Debentures details
Principal Amount	$ 3,093
Interest Rate	5.64%
Amount Included in Tier 1 Capital	$ 3,302