Loans and Allowance for Credit Losses - Allowance for loan losses by loan product and impairment methodology (Details) - USD ($) $ in Thousands	Jun. 30, 2024	Mar. 31, 2024	Dec. 31, 2023	Jun. 30, 2023	Mar. 31, 2023	Dec. 31, 2022
Accounts, Notes, Loans and Financing Receivable [Line Items]
General	$ 36,618		$ 44,473
Specific	6,325		35,710
PCD	1,889		21,422
Ending Balance	44,832	$ 67,423	101,605	$ 112,154	$ 67,780	$ 90,519
Bridge
Accounts, Notes, Loans and Financing Receivable [Line Items]
General	12,732		17,302
Specific	1,666		18,939
Ending Balance	14,398	13,181	36,241	43,857	40,319	49,905
Fixed rate
Accounts, Notes, Loans and Financing Receivable [Line Items]
General	5,415		7,884
Specific	1,065		5,714
Ending Balance	6,480	7,264	13,598	12,204	9,085	6,531
Construction
Accounts, Notes, Loans and Financing Receivable [Line Items]
General	5,840		3,722
Specific	181		5,726
PCD	1,889		21,422
Ending Balance	7,910	23,755	30,870	35,925	373	17,334
SBA 7(a)
Accounts, Notes, Loans and Financing Receivable [Line Items]
General	10,204		12,679
Specific	3,362		5,188
Ending Balance	13,566	20,579	17,867	16,809	15,110	14,299
Other
Accounts, Notes, Loans and Financing Receivable [Line Items]
General	2,427		2,886
Specific	51		143
Ending Balance	$ 2,478	$ 2,644	$ 3,029	$ 3,359	$ 2,893	$ 2,450