Loans, Impaired Financing Receivables (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2020	Sep. 30, 2019	Sep. 30, 2020	Sep. 30, 2019	Dec. 31, 2019
Impaired loans with no allocated allowance for loan losses [Abstract]
Troubled debt restructurings ("TDR")	$ 336		$ 336		$ 337
Non - TDR	1,562		1,562		1,550
Impaired loans with an allocated allowance for loan losses [Abstract]
TDR - allowance based on collateral	9,412		9,412		1,587
TDR - allowance based on present value cash flow	38,934		38,934		48,798
Non - TDR - allowance based on collateral	2,963		2,963		3,365
Total impaired loans	53,207		53,207		55,637
Amount of allowance for loan losses allocated [Abstract]
TDR - allowance based on collateral	1,104		1,104		542
TDR - allowance based on present value cash flow	3,838		3,838		4,641
Non - TDR - allowance based on collateral	1,196		1,196		972
Total amount of allowance for loan losses allocated	6,138		6,138		6,155
Impaired Loans by class [Abstract]
Recorded Investment, with no related allowance for loan losses recorded	1,898		1,898		1,887
Unpaid Principal Balance, with no related allowance for loan losses recorded	2,366		2,366		2,115
With no related allowance for loan losses recorded	0		0		0
Recorded Investment, with an allowance for loan losses recorded	51,622		51,622		54,005
Unpaid Principal Balance, with an allowance for loan losses recorded	53,416		53,416		56,708
Recorded Investment	53,520		53,520		55,892
Unpaid Principal Balance	55,782		55,782		58,823
Related Allowance	6,138		6,138		6,155
Accrued interest included in recorded investment	313		313		255
Average recorded investment in and interest income earned on impaired loans by class [Abstract]
Average Recorded Investment, with no related allowance for loan losses recorded	1,862	$ 879	1,790	$ 529
Interest Income Recognized, with no related allowance for loan losses recorded	4	13	13	15
Average Recorded Investment, with an allowance for loan losses recorded	56,522	53,636	57,198	55,786
Interest Income Recognized, with an allowance for loan losses recorded	670	740	2,334	2,213
Average Recorded Investment	58,384	54,515	58,988	56,315
Interest Income Recognized	674	753	2,347	2,228
Commercial [Member] | Commercial and Industrial [Member]
Impaired Loans by class [Abstract]
Recorded Investment, with no related allowance for loan losses recorded	122		122		257
Unpaid Principal Balance, with no related allowance for loan losses recorded	124		124		257
With no related allowance for loan losses recorded	0		0		0
Recorded Investment, with an allowance for loan losses recorded	2,452		2,452		1,655
Unpaid Principal Balance, with an allowance for loan losses recorded	2,572		2,572		1,706
Recorded Investment	2,574		2,574		1,912
Unpaid Principal Balance	2,696		2,696		1,963
Related Allowance	855		855		453
Average recorded investment in and interest income earned on impaired loans by class [Abstract]
Average Recorded Investment, with no related allowance for loan losses recorded	103	0	137	0
Interest Income Recognized, with no related allowance for loan losses recorded	2	0	4	0
Average Recorded Investment, with an allowance for loan losses recorded	2,431	1,534	2,231	2,406
Interest Income Recognized, with an allowance for loan losses recorded	38	16	105	52
Average Recorded Investment	2,534	1,534	2,368	2,406
Interest Income Recognized	40	16	109	52
Commercial [Member] | Commercial Real Estate [Member]
Impaired Loans by class [Abstract]
Recorded Investment, with no related allowance for loan losses recorded	0		0		796
Unpaid Principal Balance, with no related allowance for loan losses recorded	0		0		796
With no related allowance for loan losses recorded	0		0		0
Recorded Investment, with an allowance for loan losses recorded	7,969		7,969		6,685
Unpaid Principal Balance, with an allowance for loan losses recorded	7,980		7,980		6,661
Recorded Investment	7,969		7,969		7,481
Unpaid Principal Balance	7,980		7,980		7,457
Related Allowance	844		844		578
Average recorded investment in and interest income earned on impaired loans by class [Abstract]
Average Recorded Investment, with no related allowance for loan losses recorded	0	327	199	164
Interest Income Recognized, with no related allowance for loan losses recorded	0	5	0	5
Average Recorded Investment, with an allowance for loan losses recorded	12,195	6,069	11,657	5,552
Interest Income Recognized, with an allowance for loan losses recorded	130	71	641	221
Average Recorded Investment	12,195	6,396	11,856	5,716
Interest Income Recognized	130	76	641	226
Mortgage [Member] | 1-4 Family Owner Occupied - Jumbo [Member]
Impaired Loans by class [Abstract]
Recorded Investment, with no related allowance for loan losses recorded	632		632		0
Unpaid Principal Balance, with no related allowance for loan losses recorded	632		632		0
With no related allowance for loan losses recorded	0		0		0
Recorded Investment, with an allowance for loan losses recorded	1,091		1,091		1,447
Unpaid Principal Balance, with an allowance for loan losses recorded	1,458		1,458		1,445
Recorded Investment	1,723		1,723		1,447
Unpaid Principal Balance	2,090		2,090		1,445
Related Allowance	126		126		91
Average recorded investment in and interest income earned on impaired loans by class [Abstract]
Average Recorded Investment, with no related allowance for loan losses recorded	632	0	316	0
Interest Income Recognized, with no related allowance for loan losses recorded	0	0	0	0
Average Recorded Investment, with an allowance for loan losses recorded	808	1,003	1,228	1,248
Interest Income Recognized, with an allowance for loan losses recorded	11	9	39	26
Average Recorded Investment	1,440	1,003	1,544	1,248
Interest Income Recognized	11	9	39	26
Mortgage [Member] | 1-4 Family Owner Occupied - Non-jumbo [Member]
Impaired Loans by class [Abstract]
Recorded Investment, with no related allowance for loan losses recorded	237		237		212
Unpaid Principal Balance, with no related allowance for loan losses recorded	314		314		217
With no related allowance for loan losses recorded	0		0		0
Recorded Investment, with an allowance for loan losses recorded	21,805		21,805		10,163
Unpaid Principal Balance, with an allowance for loan losses recorded	22,414		22,414		10,695
Recorded Investment	22,042		22,042		10,375
Unpaid Principal Balance	22,728		22,728		10,912
Related Allowance	2,300		2,300		1,031
Average recorded investment in and interest income earned on impaired loans by class [Abstract]
Average Recorded Investment, with no related allowance for loan losses recorded	331	352	353	265
Interest Income Recognized, with no related allowance for loan losses recorded	0	1	4	3
Average Recorded Investment, with an allowance for loan losses recorded	22,070	23,674	19,116	24,110
Interest Income Recognized, with an allowance for loan losses recorded	277	336	901	1,031
Average Recorded Investment	22,401	24,026	19,469	24,375
Interest Income Recognized	277	337	905	1,034
Mortgage [Member] | 1-4 Non-owner Occupied [Member]
Impaired Loans by class [Abstract]
Recorded Investment, with no related allowance for loan losses recorded	311		311		214
Unpaid Principal Balance, with no related allowance for loan losses recorded	475		475		366
With no related allowance for loan losses recorded	0		0		0
Recorded Investment, with an allowance for loan losses recorded	4,473		4,473		4,962
Unpaid Principal Balance, with an allowance for loan losses recorded	4,810		4,810		5,542
Recorded Investment	4,784		4,784		5,176
Unpaid Principal Balance	5,285		5,285		5,908
Related Allowance	470		470		572
Average recorded investment in and interest income earned on impaired loans by class [Abstract]
Average Recorded Investment, with no related allowance for loan losses recorded	316	200	309	100
Interest Income Recognized, with no related allowance for loan losses recorded	2	6	5	6
Average Recorded Investment, with an allowance for loan losses recorded	4,708	5,447	4,746	6,040
Interest Income Recognized, with an allowance for loan losses recorded	52	76	170	227
Average Recorded Investment	5,024	5,647	5,055	6,140
Interest Income Recognized	54	82	175	233
Mortgage [Member] | 1-4 Family - 2nd Lien [Member]
Impaired Loans by class [Abstract]
Recorded Investment, with no related allowance for loan losses recorded	442		442		407
Unpaid Principal Balance, with no related allowance for loan losses recorded	442		442		438
With no related allowance for loan losses recorded	0		0		0
Recorded Investment, with an allowance for loan losses recorded	620		620		14,059
Unpaid Principal Balance, with an allowance for loan losses recorded	629		629		15,243
Recorded Investment	1,062		1,062		14,466
Unpaid Principal Balance	1,071		1,071		15,681
Related Allowance	133		133		1,695
Average recorded investment in and interest income earned on impaired loans by class [Abstract]
Average Recorded Investment, with no related allowance for loan losses recorded	403	0	399	0
Interest Income Recognized, with no related allowance for loan losses recorded	0	0	0	0
Average Recorded Investment, with an allowance for loan losses recorded	598	601	4,017	479
Interest Income Recognized, with an allowance for loan losses recorded	3	8	9	14
Average Recorded Investment	1,001	601	4,416	479
Interest Income Recognized	3	8	9	14
Mortgage [Member] | Resort Lending [Member]
Impaired Loans by class [Abstract]
Recorded Investment, with no related allowance for loan losses recorded	154		154		0
Unpaid Principal Balance, with no related allowance for loan losses recorded	379		379		0
With no related allowance for loan losses recorded	0		0		0
Recorded Investment, with an allowance for loan losses recorded	10,808		10,808		12,110
Unpaid Principal Balance, with an allowance for loan losses recorded	10,972		10,972		12,263
Recorded Investment	10,962		10,962		12,110
Unpaid Principal Balance	11,351		11,351		12,263
Related Allowance	1,145		1,145		1,474
Average recorded investment in and interest income earned on impaired loans by class [Abstract]
Average Recorded Investment, with no related allowance for loan losses recorded	77	0	77	0
Interest Income Recognized, with no related allowance for loan losses recorded	0	0	0	0
Average Recorded Investment, with an allowance for loan losses recorded	11,186	12,067	11,506	12,607
Interest Income Recognized, with an allowance for loan losses recorded	125	171	358	493
Average Recorded Investment	11,263	12,067	11,583	12,607
Interest Income Recognized	125	171	358	493
Installment [Member] | Boat Lending [Member]
Impaired Loans by class [Abstract]
Recorded Investment, with no related allowance for loan losses recorded	0		0		0
Unpaid Principal Balance, with no related allowance for loan losses recorded	0		0		0
With no related allowance for loan losses recorded	0		0		0
Recorded Investment, with an allowance for loan losses recorded	139		139		0
Unpaid Principal Balance, with an allowance for loan losses recorded	172		172		0
Recorded Investment	139		139		0
Unpaid Principal Balance	172		172		0
Related Allowance	49		49		0
Average recorded investment in and interest income earned on impaired loans by class [Abstract]
Average Recorded Investment, with no related allowance for loan losses recorded	0	0	0	0
Interest Income Recognized, with no related allowance for loan losses recorded	0	0	0	0
Average Recorded Investment, with an allowance for loan losses recorded	106	86	72	68
Interest Income Recognized, with an allowance for loan losses recorded	0	2	0	2
Average Recorded Investment	106	86	72	68
Interest Income Recognized	0	2	0	2
Installment [Member] | Recreational Vehicle Lending [Member]
Impaired Loans by class [Abstract]
Recorded Investment, with no related allowance for loan losses recorded	0		0		0
Unpaid Principal Balance, with no related allowance for loan losses recorded	0		0		0
With no related allowance for loan losses recorded	0		0		0
Recorded Investment, with an allowance for loan losses recorded	101		101		0
Unpaid Principal Balance, with an allowance for loan losses recorded	114		114		0
Recorded Investment	101		101		0
Unpaid Principal Balance	114		114		0
Related Allowance	23		23		0
Average recorded investment in and interest income earned on impaired loans by class [Abstract]
Average Recorded Investment, with no related allowance for loan losses recorded	0	0	0	0
Interest Income Recognized, with no related allowance for loan losses recorded	0	0	0	0
Average Recorded Investment, with an allowance for loan losses recorded	96	50	80	65
Interest Income Recognized, with an allowance for loan losses recorded	1	1	2	2
Average Recorded Investment	96	50	80	65
Interest Income Recognized	1	1	2	2
Installment [Member] | Other [Member]
Impaired Loans by class [Abstract]
Recorded Investment, with no related allowance for loan losses recorded	0		0		1
Unpaid Principal Balance, with no related allowance for loan losses recorded	0		0		41
With no related allowance for loan losses recorded	0		0		0
Recorded Investment, with an allowance for loan losses recorded	2,164		2,164		2,924
Unpaid Principal Balance, with an allowance for loan losses recorded	2,295		2,295		3,153
Recorded Investment	2,164		2,164		2,925
Unpaid Principal Balance	2,295		2,295		3,194
Related Allowance	193		193		$ 261
Average recorded investment in and interest income earned on impaired loans by class [Abstract]
Average Recorded Investment, with no related allowance for loan losses recorded	0	0	0	0
Interest Income Recognized, with no related allowance for loan losses recorded	0	1	0	1
Average Recorded Investment, with an allowance for loan losses recorded	2,324	3,105	2,545	3,211
Interest Income Recognized, with an allowance for loan losses recorded	33	50	109	145
Average Recorded Investment	2,324	3,105	2,545	3,211
Interest Income Recognized	$ 33	$ 51	$ 109	$ 146