Allowance for Credit Losses - Allocation of Allowance for Loan and Lease Losses (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2022	Jun. 30, 2021	Jun. 30, 2022	Jun. 30, 2021
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	$ 197,517	$ 266,999	$ 197,752	$ 268,018
Charge-offs	(5,831)	(3,290)	(8,130)	(5,242)
Recoveries	586	2,196	2,439	2,814
Provision for Credit Losses	3,803	(33,131)	4,014	(32,816)
Ending ACL Balance	196,075	232,774	196,075	232,774
Investor loans secured by real estate | CRE non-owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	35,974	45,545	37,380	49,176
Charge-offs	0	0	0	(154)
Recoveries	0	0	0	0
Provision for Credit Losses	1,247	1,567	(159)	(1,910)
Ending ACL Balance	37,221	47,112	37,221	47,112
Investor loans secured by real estate | Multifamily
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	54,325	79,815	55,209	62,534
Charge-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for Credit Losses	1,968	(20,756)	1,084	(3,475)
Ending ACL Balance	56,293	59,059	56,293	59,059
Investor loans secured by real estate | Construction and land
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	5,219	13,263	5,211	12,435
Charge-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for Credit Losses	217	(3,715)	225	(2,887)
Ending ACL Balance	5,436	9,548	5,436	9,548
Investor loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	3,050	5,141	3,201	5,159
Charge-offs	0	0	(70)	(265)
Recoveries	0	0	0	0
Provision for Credit Losses	(185)	(460)	(266)	(213)
Ending ACL Balance	2,865	4,681	2,865	4,681
Business loans secured by real estate | SBA secured by real estate
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	5,195	6,451	4,866	6,567
Charge-offs	0	0	0	(98)
Recoveries	0	80	0	80
Provision for Credit Losses	(46)	(214)	283	(232)
Ending ACL Balance	5,149	6,317	5,149	6,317
Business loans secured by real estate | CRE owner-occupied
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	31,891	41,594	29,575	50,517
Charge-offs	0	0	0	0
Recoveries	4	15	14	30
Provision for Credit Losses	(434)	(5,862)	1,872	(14,800)
Ending ACL Balance	31,461	35,747	31,461	35,747
Business loans secured by real estate | Franchise real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	7,977	10,876	7,985	11,451
Charge-offs	0	0	0	0
Recoveries	0	0	0	0
Provision for Credit Losses	(1,447)	560	(1,455)	(15)
Ending ACL Balance	6,530	11,436	6,530	11,436
Commercial loans | Commercial and industrial
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	38,598	43,373	38,136	46,964
Charge-offs	(5,381)	(3,290)	(7,560)	(4,569)
Recoveries	533	2,098	2,374	2,699
Provision for Credit Losses	3,298	(2,302)	4,098	(5,215)
Ending ACL Balance	37,048	39,879	37,048	39,879
Commercial loans | Franchise non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	14,304	18,903	15,084	20,525
Charge-offs	(448)	0	(448)	(156)
Recoveries	0	0	0	0
Provision for Credit Losses	(732)	(1,590)	(1,512)	(3,056)
Ending ACL Balance	13,124	17,313	13,124	17,313
Commercial loans | SBA non-real estate secured
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	490	890	565	995
Charge-offs	0	0	(50)	0
Recoveries	16	2	18	4
Provision for Credit Losses	(54)	(162)	(81)	(269)
Ending ACL Balance	452	730	452	730
Retail loans | Single family residential
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	233	822	255	1,204
Charge-offs	0	0	0	0
Recoveries	33	1	33	1
Provision for Credit Losses	12	(153)	(10)	(535)
Ending ACL Balance	278	670	278	670
Retail loans | Consumer
Allocation of allowance as well as the activity in allowance
Beginning ACL Balance	261	326	285	491
Charge-offs	(2)	0	(2)	0
Recoveries	0	0	0	0
Provision for Credit Losses	(41)	(44)	(65)	(209)
Ending ACL Balance	$ 218	$ 282	$ 218	$ 282