Investment Securities, Securities Available-for-Sale (Details) - USD ($) $ in Thousands		Jun. 30, 2020	Dec. 31, 2019	Jun. 30, 2019
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost		$ 548,600	$ 502,693	$ 484,348
Gross unrealized gains		20,935	4,905	4,000
Gross unrealized losses		128	212	255
Fair/Book value		569,407	507,386	488,093
Government Agency & Government-Sponsored Entities [Member]
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost				3,009
Gross unrealized gains				5
Gross unrealized losses				0
Fair/Book value				3,014
US Treasury Notes [Member]
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost		64,802	54,745	174,688
Gross unrealized gains		583	250	245
Gross unrealized losses		1	0	25
Fair/Book value		65,384	54,995	174,908
US Government Agency SBA [Member]
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost		9,397	10,902	13,289
Gross unrealized gains		1	9	23
Gross unrealized losses		110	113	114
Fair/Book value		9,288	10,798	13,198
Mortgage Backed Securities [Member]
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost	[1]	448,904	436,531	288,550
Gross unrealized gains	[1]	20,326	4,646	3,727
Gross unrealized losses	[1]	5	99	116
Fair/Book value	[1]	469,225	441,078	292,161
Corporate Securities [Member]
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost		10,190
Gross unrealized gains		25
Gross unrealized losses		12
Fair/Book value		10,203
Other [Member]
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost		15,307	515	4,812
Gross unrealized gains		0	0	0
Gross unrealized losses		0	0	0
Fair/Book value		$ 15,307	$ 515	$ 4,812

[1] All Mortgage Backed Securities consist of securities collateralized by residential real estate and were issued by an agency or government sponsored entity of the U.S. government.