Loans - Loan Portfolio by Classes (Details) - USD ($) $ in Thousands	Dec. 31, 2021	Dec. 31, 2020	Dec. 31, 2019
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loan Balance	$ 5,409,440	$ 5,842,337
Real estate loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loan Balance	4,006,392	4,424,031
Real estate loans | Nonowner occupied
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loan Balance	1,540,590	1,749,839
Real estate loans | Multi-family residential
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loan Balance	514,679	737,696
Real estate loans | Land development and construction loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loan Balance	327,246	349,800
Real estate loans | Commercial real estate
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loan Balance	2,382,515	2,837,335
Real estate loans | Single-family residential
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loan Balance	661,339	639,569	$ 539,102
Real estate loans | Owner-occupied
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loan Balance	962,538	947,127
Commercial loans
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loan Balance	965,673	1,154,550
Loans to financial institutions and acceptances
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loan Balance	13,710	16,636
Consumer loans and overdrafts
Accounts, Notes, Loans and Financing Receivable [Line Items]
Loan Balance	$ 423,665	$ 247,120	$ 88,466