Securities - Schedule of Contractual Maturity of Securities Available for Sale, Excluding Equity Securities (Details) - USD ($) $ in Thousands	Jun. 30, 2021	Dec. 31, 2020
Amortized Cost
1 year or less	$ 29,957
1 year – 5 years	104,797
5 years – 10 years	114,259
After 10 years	9,517
Total, Amortized Cost	258,530
Total debt securities	664,882	$ 565,493
Fair Value
1 year or less	30,055
1 year – 5 years	107,231
5 years – 10 years	117,338
After 10 years	9,702
Total, Fair Value	264,326
Total debt securities	675,100	584,908
Residential & multi-family mortgage
Amortized Cost
Mortgage & asset backed securities, Amortized Cost	384,456
Total debt securities	384,456	306,054
Fair Value
Mortgage & asset backed securities, Fair Value	388,225
Total debt securities	388,225	315,192
Pooled SBA
Amortized Cost
Mortgage & asset backed securities, Amortized Cost	21,896
Total debt securities	21,896	24,975
Fair Value
Mortgage & asset backed securities, Fair Value	22,549
Total debt securities	22,549	25,886
Other
Amortized Cost
Total debt securities	0	1,020
Fair Value
Total debt securities	$ 0	$ 979