Aging Analysis of Loans (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Financing Receivable Recorded Investment Past Due [Line Items]
Current	$ 1,114,597	$ 948,816
Total Past Due	1,122,551	966,096
Nonaccrual Loans	9,862	10,568
1-4 Family Owner-Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Current	90,381	87,243
Total Past Due	93,340	91,943
Nonaccrual Loans	3,269	3,500
Nonresidential Properties
Financing Receivable Recorded Investment Past Due [Line Items]
Current	214,499	203,514
Total Past Due	217,771	207,225
Nonaccrual Loans	4,447	4,201
Multifamily
Financing Receivable Recorded Investment Past Due [Line Items]
Current	284,555	246,318
Total Past Due	284,775	250,239
Nonaccrual Loans	210
1-4 Family Residential Investor Owned
Financing Receivable Recorded Investment Past Due [Line Items]
Current	318,955	300,324
Total Past Due	320,438	305,272
Nonaccrual Loans	1,936	1,749
Construction and Land
Financing Receivable Recorded Investment Past Due [Line Items]
Current	99,721	99,309
Total Past Due	99,721	99,309
Nonaccrual Loans		1,118
Financing Receivables, 30 to 59 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	20	11,195
Financing Receivables, 30 to 59 Days Past Due | 1-4 Family Owner-Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due		3,405
Financing Receivables, 30 to 59 Days Past Due | Nonresidential Properties
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due		3
Financing Receivables, 30 to 59 Days Past Due | Multifamily
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due		3,921
Financing Receivables, 30 to 59 Days Past Due | 1-4 Family Residential Investor Owned
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due		3,866
Financing Receivables, 60 to 89 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	1,519
Financing Receivables, 60 to 89 Days Past Due | 1-4 Family Owner-Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	1,509
Financing Receivables, 60 to 89 Days Past Due | Multifamily
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	10
Financing Receivables, Over 90 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	6,415	6,085
Financing Receivables, Over 90 Days Past Due | 1-4 Family Owner-Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	1,450	1,295
Financing Receivables, Over 90 Days Past Due | Nonresidential Properties
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	3,272	3,708
Financing Receivables, Over 90 Days Past Due | Multifamily
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	210
Financing Receivables, Over 90 Days Past Due | 1-4 Family Residential Investor Owned
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	1,483	1,082
Business
Financing Receivable Recorded Investment Past Due [Line Items]
Current	96,680	10,877
Total Past Due	96,700	10,877
Business | Financing Receivables, 30 to 59 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total Past Due	20
Consumer
Financing Receivable Recorded Investment Past Due [Line Items]
Current	9,806	1,231
Total Past Due	$ 9,806	$ 1,231