Non-Interest Revenues - Non-Interest Revenue by Business (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	$ 46,720	$ 43,239	$ 55,961
Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	42,764	39,558	52,689
Transferred over Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	3,956	3,681	3,272
Interchange and card revenue
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	28,941	30,695	41,509
Interchange and card revenue | Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	28,941	30,695	41,509
Deposit fees
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	12,815	7,824	10,039
Deposit fees | Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	12,815	7,824	10,039
University fees - card and disbursement fees | Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	1,008	1,039	1,141
University fees - subscription revenue | Transferred over Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	3,956	3,681	3,272
Customers Bank Business Banking
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	2,523	2,071	1,972
Customers Bank Business Banking | Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	2,523	2,071	1,972
Customers Bank Business Banking | Transferred over Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	0	0	0
Customers Bank Business Banking | Interchange and card revenue | Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	781	794	782
Customers Bank Business Banking | Deposit fees | Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	1,742	1,277	1,190
Customers Bank Business Banking | University fees - card and disbursement fees | Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	0	0	0
Customers Bank Business Banking | University fees - subscription revenue | Transferred over Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	0	0	0
BankMobile
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	44,197	41,168	53,989
BankMobile | Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	40,241	37,487	50,717
BankMobile | Transferred over Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	3,956	3,681	3,272
BankMobile | Interchange and card revenue | Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	28,160	29,901	40,727
BankMobile | Deposit fees | Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	11,073	6,547	8,849
BankMobile | University fees - card and disbursement fees | Transferred at Point in Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	1,008	1,039	1,141
BankMobile | University fees - subscription revenue | Transferred over Time
Disaggregation of Revenue [Line Items]
Revenue from contracts with customers	$ 3,956	$ 3,681	$ 3,272