Loans - Loans by Delinquency (Details) - USD ($) $ in Thousands	Dec. 31, 2021	Dec. 31, 2020	Dec. 31, 2019
Financing Receivable, Past Due [Line Items]
Total Loans, Net of Unearned Income	$ 5,409,440	$ 5,842,337
Current	5,378,548	5,779,827
Past Due	30,892	62,510
Loan Balance	49,773	87,479
Total Loans 90 Days or More Past Due and Accruing	8	221
30-59 Days
Financing Receivable, Past Due [Line Items]
Past Due	1,289	8,829
60-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	1,461	2,392
Greater than 90 Days
Financing Receivable, Past Due [Line Items]
Past Due	28,142	51,289
Real estate loans
Financing Receivable, Past Due [Line Items]
Total Loans, Net of Unearned Income	4,006,392	4,424,031
Current	4,001,529	4,402,725
Past Due	4,863	21,306
Loan Balance	21,076	43,041
Total Loans 90 Days or More Past Due and Accruing	0	220
Real estate loans | 30-59 Days
Financing Receivable, Past Due [Line Items]
Past Due	990	5,069
Real estate loans | 60-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	412	671
Real estate loans | Greater than 90 Days
Financing Receivable, Past Due [Line Items]
Past Due	3,461	15,566
Real estate loans | Non-owner occupied
Financing Receivable, Past Due [Line Items]
Total Loans, Net of Unearned Income	1,540,590	1,749,839
Current	1,540,590	1,741,862
Past Due	0	7,977
Loan Balance	7,285	8,219
Total Loans 90 Days or More Past Due and Accruing	0	0
Real estate loans | Non-owner occupied | 30-59 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	1,487
Real estate loans | Non-owner occupied | 60-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Real estate loans | Non-owner occupied | Greater than 90 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	6,490
Real estate loans | Multi-family residential
Financing Receivable, Past Due [Line Items]
Total Loans, Net of Unearned Income	514,679	737,696
Current	514,679	737,696
Past Due	0	0
Loan Balance	0	11,340
Total Loans 90 Days or More Past Due and Accruing	0	0
Real estate loans | Multi-family residential | 30-59 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Real estate loans | Multi-family residential | 60-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Real estate loans | Multi-family residential | Greater than 90 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Real estate loans | Land development and construction loans
Financing Receivable, Past Due [Line Items]
Total Loans, Net of Unearned Income	327,246	349,800
Current	327,246	349,800
Past Due	0	0
Loan Balance	0	0
Total Loans 90 Days or More Past Due and Accruing	0	0
Real estate loans | Land development and construction loans | 30-59 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Real estate loans | Land development and construction loans | 60-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Real estate loans | Land development and construction loans | Greater than 90 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Real estate loans | Commercial real estate
Financing Receivable, Past Due [Line Items]
Total Loans, Net of Unearned Income	2,382,515	2,837,335
Current	2,382,515	2,829,358
Past Due	0	7,977
Loan Balance	7,285	19,559
Total Loans 90 Days or More Past Due and Accruing	0	0
Real estate loans | Commercial real estate | 30-59 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	1,487
Real estate loans | Commercial real estate | 60-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Real estate loans | Commercial real estate | Greater than 90 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	6,490
Real estate loans | Single-family residential
Financing Receivable, Past Due [Line Items]
Total Loans, Net of Unearned Income	661,339	639,569	$ 539,102
Current	657,882	631,801
Past Due	3,457	7,768
Loan Balance	5,126	10,667	7,291
Total Loans 90 Days or More Past Due and Accruing	0	0
Real estate loans | Single-family residential | 30-59 Days
Financing Receivable, Past Due [Line Items]
Past Due	990	3,143
Loan Balance	459	1,336	253
Real estate loans | Single-family residential | 60-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	412	671
Loan Balance	0	44	266
Real estate loans | Single-family residential | Greater than 90 Days
Financing Receivable, Past Due [Line Items]
Past Due	2,055	3,954
Loan Balance	2,055	3,954	2,870
Real estate loans | Owner-occupied
Financing Receivable, Past Due [Line Items]
Total Loans, Net of Unearned Income	962,538	947,127
Current	961,132	941,566
Past Due	1,406	5,561
Loan Balance	8,665	12,815
Total Loans 90 Days or More Past Due and Accruing	0	220
Real estate loans | Owner-occupied | 30-59 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	439
Real estate loans | Owner-occupied | 60-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Real estate loans | Owner-occupied | Greater than 90 Days
Financing Receivable, Past Due [Line Items]
Past Due	1,406	5,122
Commercial loans
Financing Receivable, Past Due [Line Items]
Total Loans, Net of Unearned Income	965,673	1,154,550
Current	939,685	1,113,469
Past Due	25,988	41,081
Loan Balance	28,440	44,205
Total Loans 90 Days or More Past Due and Accruing	0	0
Commercial loans | 30-59 Days
Financing Receivable, Past Due [Line Items]
Past Due	277	3,675
Commercial loans | 60-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	1,042	1,715
Commercial loans | Greater than 90 Days
Financing Receivable, Past Due [Line Items]
Past Due	24,669	35,691
Loans to financial institutions and acceptances
Financing Receivable, Past Due [Line Items]
Total Loans, Net of Unearned Income	13,710	16,636
Current	13,710	16,636
Past Due	0	0
Loan Balance	0	0
Total Loans 90 Days or More Past Due and Accruing	0	0
Loans to financial institutions and acceptances | 30-59 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Loans to financial institutions and acceptances | 60-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Loans to financial institutions and acceptances | Greater than 90 Days
Financing Receivable, Past Due [Line Items]
Past Due	0	0
Consumer loans and overdrafts
Financing Receivable, Past Due [Line Items]
Total Loans, Net of Unearned Income	423,665	247,120	88,466
Current	423,624	246,997
Past Due	41	123
Loan Balance	257	233	416
Total Loans 90 Days or More Past Due and Accruing	8	1
Consumer loans and overdrafts | 30-59 Days
Financing Receivable, Past Due [Line Items]
Past Due	22	85
Loan Balance	0	0	0
Consumer loans and overdrafts | 60-89 Days
Financing Receivable, Past Due [Line Items]
Past Due	7	6
Loan Balance	2	0	2
Consumer loans and overdrafts | Greater than 90 Days
Financing Receivable, Past Due [Line Items]
Past Due	12	32
Loan Balance	$ 4	$ 30	$ 40