Income Taxes - Reconciliation (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2021	Dec. 31, 2020	Dec. 31, 2019
Amount
Tax expense (benefit) calculated at the statutory federal income tax rate	$ 30,244	$ (910)	$ 13,447
Non-taxable interest income	(350)	(634)	(1,132)
Non-taxable BOLI income	(1,146)	(1,196)	(1,199)
Stock-based compensation	(856)	(55)	(454)
State and city income taxes, net of federal income tax benefit	3,697	1,709	1,800
Rate differential on deferred items	769	(1,907)	162
Noncontrolling interest	548	0	0
Disallowed interest expense allocable to tax exempt securities and other expenses	421	396	624
Other, net	382	(15)	(551)
Total income tax expense (benefit)	$ 33,709	$ (2,612)	$ 12,697
%
Tax expense (benefit) calculated at the statutory federal income tax rate	21.00%	21.00%	21.00%
Non-taxable interest income	(0.24%)	14.62%	(1.77%)
Non-taxable BOLI income	(0.80%)	27.59%	(1.87%)
Stock-based compensation	(0.59%)	1.27%	(0.71%)
State and city income taxes, net of federal income tax benefit	2.57%	(39.43%)	2.81%
Rate differential on deferred items	0.53%	44.00%	0.25%
Noncontrolling interest	0.38%	0.00%	0.00%
Disallowed interest expense allocable to tax exempt securities and other expenses	0.29%	(9.14%)	0.97%
Other, net	0.27%	0.36%	(0.85%)
Total income tax expense (benefit)	23.41%	60.27%	19.83%