Fair Value Accounting (Fair Value Inputs, Assets, Quantitative Information) (Details) - USD ($) $ in Thousands	3 Months Ended	9 Months Ended
	Sep. 30, 2020	Sep. 30, 2020	Jun. 30, 2020	Dec. 31, 2019	Sep. 30, 2019	Jun. 30, 2019	Dec. 31, 2018
Investment Securities Available for Sale
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Asset measured with unobservable inputs	$ 1,800	$ 1,800	$ 1,662	$ 2,105	$ 1,991	$ 2,017	$ 1,785
Private Equity Investments
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Asset measured with unobservable inputs	958	958	$ 698	$ 3,887	$ 11,289	$ 13,341	$ 11,028
Fair Value, Measurements, Recurring Basis | Level 3 | Investment Securities Available for Sale | Discounted cash flow analysis
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Asset measured with unobservable inputs	1,800	$ 1,800
Discount rate		5.83%
Forecasted average Prime reset rate		3.79%
Fair Value, Measurements, Recurring Basis | Level 3 | Private Equity Investments | Individual analysis of each investee company
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Asset measured with unobservable inputs	958	$ 958
Fair Value, Measurements, Recurring Basis | Level 3 | GGL/SBA loans servicing asset | Discounted cash flow analysis
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Asset measured with unobservable inputs	$ 3,100	3,100
Discount rate	9.68%
Prepayment speeds	19.20%
Fair Value, Measurements, Recurring Basis | Level 3 | Earnout liability | Option pricing methods and Monte Carlo simulation
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure	$ 15,924	15,924
Fair Value, Measurements, Recurring Basis | Level 3 | Visa derivative liability | Discounted cash flow analysis
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, fair value disclosure	$ 1,460	$ 1,460
Estimated timing of resolution of Covered Litigation and future cumulative deposits to the litigation escrow for settlement of the Covered Litigation		1 year 2 months 12 days
Fair Value, Measurements, Nonrecurring Basis | Level 3 | Loans | Third-party appraised value of real estate less estimated selling costs | Minimum
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Discount rate		0.00%
Estimated selling costs		0.00%
Fair Value, Measurements, Nonrecurring Basis | Level 3 | Loans | Third-party appraised value of real estate less estimated selling costs | Maximum
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Discount rate		36.00%
Estimated selling costs		10.00%
Fair Value, Measurements, Nonrecurring Basis | Level 3 | Loans | Third-party appraised value of real estate less estimated selling costs | Weighted Average
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Discount rate		28.00%
Estimated selling costs		7.00%
Fair Value, Measurements, Nonrecurring Basis | Level 3 | Other real estate | Third-party appraised value of real estate less estimated selling costs | Minimum
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Discount rate		0.00%
Estimated selling costs		0.00%
Fair Value, Measurements, Nonrecurring Basis | Level 3 | Other real estate | Third-party appraised value of real estate less estimated selling costs | Maximum
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Discount rate		20.00%
Estimated selling costs		10.00%
Fair Value, Measurements, Nonrecurring Basis | Level 3 | Other real estate | Third-party appraised value of real estate less estimated selling costs | Weighted Average
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Discount rate		10.00%
Estimated selling costs		7.00%
Fair Value, Measurements, Nonrecurring Basis | Level 3 | Other Assets Held for Sale [Member] | Third-party appraised value less estimated selling costs or BOV | Minimum
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Discount rate		0.00%
Estimated selling costs		0.00%
Fair Value, Measurements, Nonrecurring Basis | Level 3 | Other Assets Held for Sale [Member] | Third-party appraised value less estimated selling costs or BOV | Maximum
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Discount rate		66.00%
Estimated selling costs		10.00%
Fair Value, Measurements, Nonrecurring Basis | Level 3 | Other Assets Held for Sale [Member] | Third-party appraised value less estimated selling costs or BOV | Weighted Average
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Discount rate		53.00%
Estimated selling costs		7.00%