Loans Receivable and Allowance for Credit Losses - Composition of Allowance for Loan Losses and Related Recorded Investment in Loans (Details) - USD ($) $ in Thousands	3 Months Ended		12 Months Ended
	Mar. 31, 2024	Mar. 31, 2023	Dec. 31, 2023
Financing Receivable Allowance For Credit Losses [Line Items]
Balance, beginning of period	$ 26,154	$ 34,592	$ 34,592
Provision (benefit) charged to expense	(255)	(321)	1,237
Impact of CECL adoption		(3,090)	(3,090)
Charged-offs	(1,354)	(2,569)	(7,290)
Recoveries	119	363	705
Balance, end of period	24,664	28,975	26,154
Ending balance: individually evaluated for impairment	217	237	233
Ending balance: collectively evaluated for impairment	24,447	28,738	25,921
Ending balance: individually evaluated for impairment	13,135	24,986	12,726
Ending balance: collectively evaluated for impairment	1,992,283	1,616,318	1,908,846
Total	2,005,418	1,641,304	1,921,572
1-4 Family Investor Owned
Financing Receivable Allowance For Credit Losses [Line Items]
Balance, beginning of period	4,415	3,863	3,863
Provision (benefit) charged to expense	(158)	135	(214)
Impact of CECL adoption		766	766
Balance, end of period	4,257	4,764	4,415
Ending balance: individually evaluated for impairment		60
Ending balance: collectively evaluated for impairment	4,257	4,704	4,415
Ending balance: individually evaluated for impairment	399	5,234	793
Ending balance: collectively evaluated for impairment	338,932	349,325	342,896
Total	339,331	354,559	343,689
1-4 Family Owner-Occupied
Financing Receivable Allowance For Credit Losses [Line Items]
Balance, beginning of period	2,012	1,723	1,723
Provision (benefit) charged to expense	(49)	182	143
Impact of CECL adoption		146	146
Balance, end of period	1,963	2,051	2,012
Ending balance: individually evaluated for impairment	75	100	72
Ending balance: collectively evaluated for impairment	1,888	1,951	1,940
Ending balance: individually evaluated for impairment	1,874	5,576	2,130
Ending balance: collectively evaluated for impairment	148,968	143,905	150,181
Total	150,842	149,481	152,311
Multifamily
Financing Receivable Allowance For Credit Losses [Line Items]
Balance, beginning of period	4,365	8,021	8,021
Provision (benefit) charged to expense	(151)	455	306
Impact of CECL adoption		(3,962)	(3,962)
Balance, end of period	4,214	4,514	4,365
Ending balance: collectively evaluated for impairment	4,214	4,514	4,365
Ending balance: individually evaluated for impairment	4,098	1,439	2,979
Ending balance: collectively evaluated for impairment	541,727	551,991	547,580
Total	545,825	553,430	550,559
Nonresidential
Financing Receivable Allowance For Credit Losses [Line Items]
Balance, beginning of period	3,176	2,724	2,724
Provision (benefit) charged to expense	(940)	16	(126)
Impact of CECL adoption		578	578
Balance, end of period	2,236	3,318	3,176
Ending balance: individually evaluated for impairment		37
Ending balance: collectively evaluated for impairment	2,236	3,281	3,176
Ending balance: individually evaluated for impairment	441	792
Ending balance: collectively evaluated for impairment	326,909	313,768	342,343
Total	327,350	314,560	342,343
Construction and Land
Financing Receivable Allowance For Credit Losses [Line Items]
Balance, beginning of period	4,807	2,683	2,683
Provision (benefit) charged to expense	1,596	750	3,035
Impact of CECL adoption		(911)	(911)
Balance, end of period	6,403	2,522	4,807
Ending balance: collectively evaluated for impairment	6,403	2,522	4,807
Ending balance: individually evaluated for impairment	6,177	11,905	6,659
Ending balance: collectively evaluated for impairment	602,488	223,252	497,266
Total	608,665	235,157	503,925
Business Loans
Financing Receivable Allowance For Credit Losses [Line Items]
Balance, beginning of period	531	120	120
Provision (benefit) charged to expense	82	1	235
Impact of CECL adoption		236	236
Charged-offs	(52)		(63)
Recoveries			3
Balance, end of period	561	357	531
Ending balance: individually evaluated for impairment	142	40	161
Ending balance: collectively evaluated for impairment	419	317	370
Ending balance: individually evaluated for impairment	146	40	165
Ending balance: collectively evaluated for impairment	26,518	19,850	19,614
Total	26,664	19,890	19,779
Consumer
Financing Receivable Allowance For Credit Losses [Line Items]
Balance, beginning of period	6,848	15,458	15,458
Provision (benefit) charged to expense	(635)	(1,860)	(2,142)
Impact of CECL adoption		57	57
Charged-offs	(1,302)	(2,569)	(7,227)
Recoveries	119	363	702
Balance, end of period	5,030	11,449	6,848
Ending balance: collectively evaluated for impairment	5,030	11,449	6,848
Ending balance: collectively evaluated for impairment	6,741	14,227	8,966
Total	$ 6,741	$ 14,227	$ 8,966