Loan Portfolio and Allowance for Credit Losses, Allowance for Credit Losses (Details) - USD ($) $ in Thousands		3 Months Ended		6 Months Ended
		Jun. 30, 2022	Jun. 30, 2021	Jun. 30, 2022	Jun. 30, 2021
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period		$ 46,178	$ 49,991	$ 44,267
Balance at beginning of period				44,267	$ 49,595
Loans charged off [Abstract]
Total loan charge offs		30	21	77	116
Recoveries of loans previously charged off [Abstract]
Total recoveries		137	185	242	326
Net loans (recoveries) charged off		(107)	(164)	(165)	(210)
(Credit) provision for credit losses		(1,000)	0	(1,500)	350
Balance at end of period		45,285	50,155	45,285	50,155
Balance at end of period			50,155		50,155
New York and Other States [Member]
Loans charged off [Abstract]
Total loan charge offs	[1]	30	21	77	114
Recoveries of loans previously charged off [Abstract]
Total recoveries	[1]	137	184	242	325
Florida [Member]
Loans charged off [Abstract]
Total loan charge offs		0	0	0	2
Recoveries of loans previously charged off [Abstract]
Total recoveries		0	1	0	1
Commercial [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period		2,177	4,052	3,135
Balance at beginning of period				3,135	4,140
Loans charged off [Abstract]
Total loan charge offs		4	0	40	0
Recoveries of loans previously charged off [Abstract]
Total recoveries		4	0	4	32
Net loans (recoveries) charged off		0	0	36	(32)
(Credit) provision for credit losses		97	54	161	(66)
Balance at end of period		2,274	4,106	2,274	4,106
Balance at end of period			4,106		4,106
Commercial [Member] | New York and Other States [Member]
Loans charged off [Abstract]
Total loan charge offs	[1]	4	0	40	0
Recoveries of loans previously charged off [Abstract]
Total recoveries	[1]	4	0	4	32
Commercial [Member] | Florida [Member]
Loans charged off [Abstract]
Total loan charge offs		0	0	0	0
Recoveries of loans previously charged off [Abstract]
Total recoveries		0	0	0	0
Real Estate Mortgage - 1 to 4 Family [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period		43,931	45,507	40,689
Balance at beginning of period				40,689	44,950
Loans charged off [Abstract]
Total loan charge offs		12	20	12	106
Recoveries of loans previously charged off [Abstract]
Total recoveries		131	157	228	245
Net loans (recoveries) charged off		(119)	(137)	(216)	(139)
(Credit) provision for credit losses		(1,170)	(27)	(1,742)	528
Balance at end of period		42,880	45,617	42,880	45,617
Balance at end of period			45,617		45,617
Real Estate Mortgage - 1 to 4 Family [Member] | New York and Other States [Member]
Loans charged off [Abstract]
Total loan charge offs	[1]	12	20	12	106
Recoveries of loans previously charged off [Abstract]
Total recoveries	[1]	131	156	228	244
Real Estate Mortgage - 1 to 4 Family [Member] | Florida [Member]
Loans charged off [Abstract]
Total loan charge offs		0	0	0	0
Recoveries of loans previously charged off [Abstract]
Total recoveries		0	1	0	1
Installment [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period		70	432	443
Balance at beginning of period				443	505
Loans charged off [Abstract]
Total loan charge offs		14	1	25	10
Recoveries of loans previously charged off [Abstract]
Total recoveries		2	28	10	49
Net loans (recoveries) charged off		12	(27)	15	(39)
(Credit) provision for credit losses		73	(27)	81	(112)
Balance at end of period		131	432	131	432
Balance at end of period			432		432
Installment [Member] | New York and Other States [Member]
Loans charged off [Abstract]
Total loan charge offs	[1]	14	1	25	8
Recoveries of loans previously charged off [Abstract]
Total recoveries	[1]	2	28	10	49
Installment [Member] | Florida [Member]
Loans charged off [Abstract]
Total loan charge offs		0	0	0	2
Recoveries of loans previously charged off [Abstract]
Total recoveries		$ 0	$ 0	0	$ 0
ASU 2016-13 [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period				46,620
ASU 2016-13 [Member] | Commercial [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period				2,149
ASU 2016-13 [Member] | Real Estate Mortgage - 1 to 4 Family [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period				44,406
ASU 2016-13 [Member] | Installment [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period				65
ASU 2016-13 [Member] | Impact of Adoption [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period				2,353
ASU 2016-13 [Member] | Impact of Adoption [Member] | Commercial [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period				(986)
ASU 2016-13 [Member] | Impact of Adoption [Member] | Real Estate Mortgage - 1 to 4 Family [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period				3,717
ASU 2016-13 [Member] | Impact of Adoption [Member] | Installment [Member]
Allowance for loan losses by portfolio segment [Roll Forward]
Balance at beginning of period				$ (378)

[1] Includes New York, New Jersey, Vermont and Massachusetts.