Discontinued Operations and Assets and Liabilities Held For Sale (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2024	Jun. 30, 2023	Jun. 30, 2024	Jun. 30, 2023	Dec. 31, 2023
Assets:
Total Assets	$ 423,894		$ 423,894		$ 454,596
Liabilities:
Total Liabilities	332,265		332,265		333,157
Non-interest expense
Income (loss) from discontinued operations before provision for income taxes	(3,699)	$ 11,788	(1,812)	$ 9,747
Income tax benefit (provision)	925	(2,947)	453	(2,437)
Residential Mortgage Banking
Assets:
Cash and cash equivalents	20,438		20,438		13,694
Restricted cash	5,666		5,666		6,314
Loans, net	3,860		3,860		2,778
Loans, held for sale	156,264		156,264		133,204
Loans eligible for repurchase from Ginnie Mae	89,679		89,679		86,872
Derivative instruments					847
Servicing rights	125,795		125,795		188,855
Other assets	22,192		22,192		22,032
Total Assets	423,894		423,894		454,596
Liabilities:
Secured borrowings	229,906		229,906		230,965
Liabilities for loans eligible for repurchase from Ginnie Mae	89,679		89,679		86,872
Derivative instruments	813		813		1,321
Accounts payable and other accrued liabilities	11,867		11,867		13,999
Total Liabilities	332,265		332,265		$ 333,157
Interest income	2,121	1,880	3,962	3,485
Interest expense	(2,755)	(2,313)	(5,285)	(3,839)
Net interest expense	(634)	(433)	(1,323)	(354)
Non-interest income
Residential mortgage banking activities	11,353	9,884	20,595	19,053
Net realized gain (loss) on financial instruments	2,938		2,938
Net unrealized gain (loss) on financial instruments	(7,219)	8,818	(7,219)	2,725
Servicing income, net of amortization and impairment	8,472	9,393	17,888	18,754
Other income	4	23	8	54
Total non-interest income	15,548	28,118	34,210	40,586
Non-interest expense
Employee compensation and benefits	(5,818)	(5,295)	(11,502)	(10,707)
Variable expenses on residential mortgage banking activities	(8,122)	(6,574)	(14,208)	(12,059)
Professional fees	(259)	(123)	(412)	(297)
Loan servicing expense	(2,412)	(2,221)	(4,741)	(4,029)
Other operating expenses	(2,002)	(1,684)	(3,836)	(3,393)
Total non-interest expense	(18,613)	(15,897)	(34,699)	(30,485)
Income (loss) from discontinued operations before provision for income taxes	(3,699)	11,788	(1,812)	9,747
Income tax benefit (provision)	925	(2,947)	453	(2,437)
Net income (loss) from discontinued operations	(2,774)	$ 8,841	(1,359)	$ 7,310
Residential Mortgage Banking | Sale
Discontinued operations
Consideration from sale of discontinued operations	61,800		61,800
Mortgage servicing rights sold	$ 4,700,000		$ 4,700,000