Investment Securities, Securities Available-for-Sale (Details) - USD ($) $ in Thousands		Sep. 30, 2019	Dec. 31, 2018	Sep. 30, 2018
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost		$ 488,503	$ 499,639	$ 467,628
Gross unrealized gains		4,710	1,208	278
Gross unrealized losses		283	5,451	9,595
Fair value		492,930	495,396	458,311
Government Agency & Government-Sponsored Entities [Member]
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost			3,033	3,045
Gross unrealized gains			6	7
Gross unrealized losses			0	0
Fair value			3,039	3,052
US Treasury Notes [Member]
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost		129,724	164,672	164,671
Gross unrealized gains		270	0	0
Gross unrealized losses		5	158	463
Fair value		129,989	164,514	164,208
US Government Agency SBA [Member]
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost		11,844	15,601	17,144
Gross unrealized gains		15	6	6
Gross unrealized losses		115	160	177
Fair value		11,744	15,447	16,973
Mortgage Backed Securities [Member]
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost	[1]	343,295	310,982	279,757
Gross unrealized gains	[1]	4,425	1,196	265
Gross unrealized losses	[1]	163	5,133	8,955
Fair value	[1]	347,557	307,045	271,067
Other [Member]
Amortized cost, fair values, and unrealized gains and losses of securities available-for-sale [Abstract]
Amortized cost		3,640	5,351	3,011
Gross unrealized gains		0	0	0
Gross unrealized losses		0	0	0
Fair value		$ 3,640	$ 5,351	$ 3,011

[1] All Mortgage Backed Securities consist of securities collateralized by residential real estate and were issued by an agency or government sponsored entity of the U.S. government.