Income Taxes - Deferred Tax Assets and Liabilities (Details) - USD ($) $ in Thousands	Dec. 31, 2023	Dec. 31, 2022
Deferred tax assets:
Federal and state net operating loss	$ 22,852	$ 25,118
Allowance for credit losses	18,950	15,537
Unrealized loss on securities	13,920	14,235
Deferred compensation	3,005	4,756
Fair value adjustments on loans	1,626	2,428
Share-based compensation	2,529	2,208
Accrued expenses	881	1,320
Deferred loan fees	826	1,044
Lease liability	519	1,044
Fair value adjustments on deposits	99	326
Other real estate owned and foreclosed assets	0	7
Other	5,437	4,559
Total deferred tax assets	70,644	72,582
Deferred tax liabilities:
Mortgage servicing rights	18,079	17,465
Fair value adjustments on intangible assets	2,889	3,596
Prepaid expenses	1,193	1,143
Premises and equipment	1,281	918
Fair value adjustments on debt	606	700
FHLB stock	144	196
Other	193	209
Total deferred tax liabilities	24,385	24,227
Total deferred tax assets, net	$ 46,259	$ 48,355