Business Segments (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2020	Mar. 31, 2019	Dec. 31, 2019
Segment Reporting Information [Line Items]
Interest income	$ 125,343	$ 101,075
Interest expense	44,022	41,771
Net interest income	81,321	59,304
Provision for credit losses on loans and leases	31,786	4,767
Total non-interest income	21,930	19,718
Non-interest expense	66,459	53,984
Income before income tax expense	5,006	20,271
Income tax expense (benefit)	1,906	4,831
Net income (loss)	3,100	15,440
Preferred stock dividends	3,615	3,615
Net income (loss) available to common shareholders	(515)	11,825
Goodwill and other intangibles	14,870		$ 15,195
Total assets	12,018,799		11,520,717
Total deposits	8,413,643		$ 8,648,936
Operating Segments
Segment Reporting Information [Line Items]
Interest income	125,343	101,075
Interest expense	44,022	41,771
Net interest income	81,321	59,304
Provision for credit losses on loans and leases	31,786	4,767
Total non-interest income	21,930	19,718
Non-interest expense	66,459	53,984
Income before income tax expense	5,006	20,271
Income tax expense (benefit)	1,906	4,831
Net income (loss)	3,100	15,440
Preferred stock dividends	3,615	3,615
Net income (loss) available to common shareholders	(515)	11,825
Goodwill and other intangibles	14,870	16,173
Total assets	12,018,799	10,143,894
Total deposits	8,413,643	7,425,318
Total non-deposit liabilities	2,640,520	1,740,203
Operating Segments | Customers Bank Business Banking
Segment Reporting Information [Line Items]
Interest income	112,717	92,871
Interest expense	43,678	41,605
Net interest income	69,039	51,266
Provision for credit losses on loans and leases	27,298	2,976
Total non-interest income	11,136	7,577
Non-interest expense	43,860	35,384
Income before income tax expense	9,017	20,483
Income tax expense (benefit)	2,722	4,880
Net income (loss)	6,295	15,603
Preferred stock dividends	3,615	3,615
Net income (loss) available to common shareholders	2,680	11,988
Goodwill and other intangibles	3,629	3,629
Total assets	11,418,000	9,916,308
Total deposits	7,803,878	6,798,562
Total non-deposit liabilities	2,611,684	1,719,469
Operating Segments | BankMobile
Segment Reporting Information [Line Items]
Interest income	12,626	8,204
Interest expense	344	166
Net interest income	12,282	8,038
Provision for credit losses on loans and leases	4,488	1,791
Total non-interest income	10,794	12,141
Non-interest expense	22,599	18,600
Income before income tax expense	(4,011)	(212)
Income tax expense (benefit)	(816)	(49)
Net income (loss)	(3,195)	(163)
Preferred stock dividends	0	0
Net income (loss) available to common shareholders	(3,195)	(163)
Goodwill and other intangibles	11,241	12,544
Total assets	600,799	227,586
Total deposits	609,765	626,756
Total non-deposit liabilities	28,836	20,734
Segment Reconciling Items | BankMobile
Segment Reporting Information [Line Items]
Interest income	$ 1,400	$ 5,600