Accrued Expenses and Other Liabilities (Details) - USD ($) $ in Thousands	Dec. 31, 2021	Dec. 31, 2020
Payables and Accruals [Abstract]
Derivative financial instruments	$ 14,408	$ 30,891
Salary and employee benefits	31,794	25,800
FRB courtesy inclearings	11,094	5,214
MPF servicing principal and interest payable	5,568	13,668
Loans subject to unilateral repurchase rights - Ginnie Mae	4,189	7,426
Professional fees	2,100	1,727
Property taxes payable	619	561
Lease terminations	458	1,579
Software incentive payment	382	1,037
Deferred rent	3,170	2,503
Other	10,126	8,978
Total accrued expenses and other liabilities	$ 83,908	$ 99,384