Accrued Expenses and Other Liabilities (Details) - USD ($) $ in Thousands	Dec. 31, 2023	Dec. 31, 2022
Payables and Accruals [Abstract]
Lease liability	$ 26,431	$ 31,267
Salary and employee benefits	30,549	29,834
Derivative financial instruments	20,505	24,527
Loans subject to unilateral repurchase rights - Ginnie Mae	23,430	12,224
FRB courtesy inclearings	6,139	6,821
Professional fees	1,607	1,757
Property taxes payable	1,260	886
MPF servicing principal and interest payable	522	885
Other	14,927	15,884
Total accrued expenses and other liabilities	$ 125,370	$ 124,085
Operating Lease, Liability, Statement of Financial Position [Extensible Enumeration]	Total accrued expenses and other liabilities	Total accrued expenses and other liabilities