Fair Value of Financial Instruments - Schedule of Quantitative Information for Level 3 Fair Value Measurements (Details) $ in Thousands	Mar. 31, 2021 USD ($)	Dec. 31, 2020 USD ($)
Level 3
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, fair value	$ 13,276,121	$ 13,351,092
Recurring | Level 3 | Black-Scholes option pricing model
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Equity warrants	$ 1,911	$ 1,914
Recurring | Level 3 | Black-Scholes option pricing model | Volatility | Min
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Equity warrants, input	0.3000	0.3000
Recurring | Level 3 | Black-Scholes option pricing model | Volatility | Max
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Equity warrants, input	0.3500	0.3500
Recurring | Level 3 | Black-Scholes option pricing model | Volatility | Weighted Average
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Equity warrants, input	0.3118	0.3119
Recurring | Level 3 | Black-Scholes option pricing model | Risk free interest rate | Min
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Equity warrants, input	0.0016	0.0013
Recurring | Level 3 | Black-Scholes option pricing model | Risk free interest rate | Max
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Equity warrants, input	0.0064	0.0036
Recurring | Level 3 | Black-Scholes option pricing model | Risk free interest rate | Weighted Average
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Equity warrants, input	0.0027	0.0018
Recurring | Level 3 | Black-Scholes option pricing model | Marketability Discount | Min
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Equity warrants, input	0.0600	0.0600
Recurring | Level 3 | Black-Scholes option pricing model | Marketability Discount | Max
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Equity warrants, input	0.1600	0.1600
Recurring | Level 3 | Black-Scholes option pricing model | Marketability Discount | Weighted Average
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Equity warrants, input	0.1352	0.1351
Nonrecurring
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, fair value	$ 606	$ 4,077
Nonrecurring | Level 3
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, fair value	606	4,077
Nonrecurring | Level 3 | Fair value of collateral | Investor loans secured by real estate | CRE non-owner-occupied
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, fair value		$ 198
Nonrecurring | Level 3 | Fair value of collateral | Investor loans secured by real estate | CRE non-owner-occupied | Collateral discount and cost to sell | Min
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input		0.1000
Nonrecurring | Level 3 | Fair value of collateral | Investor loans secured by real estate | CRE non-owner-occupied | Collateral discount and cost to sell | Max
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input		0.1000
Nonrecurring | Level 3 | Fair value of collateral | Investor loans secured by real estate | CRE non-owner-occupied | Collateral discount and cost to sell | Weighted Average
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input		0.1000
Nonrecurring | Level 3 | Fair value of collateral | Investor loans secured by real estate | SBA secured by real estate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, fair value	$ 440	$ 746
Nonrecurring | Level 3 | Fair value of collateral | Investor loans secured by real estate | SBA secured by real estate | Collateral discount and cost to sell | Min
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input	0.1000	0.1000
Nonrecurring | Level 3 | Fair value of collateral | Investor loans secured by real estate | SBA secured by real estate | Collateral discount and cost to sell | Max
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input	0.1000	0.1000
Nonrecurring | Level 3 | Fair value of collateral | Investor loans secured by real estate | SBA secured by real estate | Collateral discount and cost to sell | Weighted Average
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input	0.1000	0.1000
Nonrecurring | Level 3 | Fair value of collateral | Business loans secured by real estate | SBA secured by real estate
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, fair value		$ 386
Nonrecurring | Level 3 | Fair value of collateral | Business loans secured by real estate | SBA secured by real estate | Collateral discount and cost to sell | Min
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input		0.0700
Nonrecurring | Level 3 | Fair value of collateral | Business loans secured by real estate | SBA secured by real estate | Collateral discount and cost to sell | Max
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input		0.1000
Nonrecurring | Level 3 | Fair value of collateral | Business loans secured by real estate | SBA secured by real estate | Collateral discount and cost to sell | Weighted Average
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input		0.0909
Nonrecurring | Level 3 | Fair value of collateral | Commercial loans | Commercial and industrial
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, fair value	$ 166	$ 2,040
Nonrecurring | Level 3 | Fair value of collateral | Commercial loans | Commercial and industrial | Collateral discount and cost to sell | Min
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input	0.7500	0.0700
Nonrecurring | Level 3 | Fair value of collateral | Commercial loans | Commercial and industrial | Collateral discount and cost to sell | Max
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input	1.0000	0.1000
Nonrecurring | Level 3 | Fair value of collateral | Commercial loans | Commercial and industrial | Collateral discount and cost to sell | Weighted Average
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input	0.7500	0.0906
Nonrecurring | Level 3 | Fair value of collateral | Commercial loans | SBA non-real estate secured
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, fair value		$ 707
Nonrecurring | Level 3 | Fair value of collateral | Commercial loans | SBA non-real estate secured | Collateral discount and cost to sell | Min
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input		0.0700
Nonrecurring | Level 3 | Fair value of collateral | Commercial loans | SBA non-real estate secured | Collateral discount and cost to sell | Max
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input		0.0700
Nonrecurring | Level 3 | Fair value of collateral | Commercial loans | SBA non-real estate secured | Collateral discount and cost to sell | Weighted Average
Fair Value Measurement Inputs and Valuation Techniques [Line Items]
Loans receivable, input		0.0700