Investment Securities Schedule of Available for Sale Securities (Details) $ in Thousands	Dec. 31, 2016 USD ($)	Dec. 31, 2015 USD ($)
Schedule of Available-for-sale Securities [Line Items]
Available-For-Sale Securities, at Amortized Cost	$ 347,615	$ 401,278
Available-for-Sale	346,996	402,309
Gross Unrealized Gains	1,576	2,717
Gross Unrealized Losses	2,195	1,686
Available-For-Sale Securities, Pledged as Collateral, at Fair Value	262,852	310,857
Maturities of Debt Securities, at Amortized Cost:
Within One Year	25,229	184,276
From 1 - 5 Years	257,733	13,017
From 5 - 10 Years	61,973	197,293
Over 10 Years	1,560	0
Maturities of Debt Securities, at Fair Value:
Within One Year	25,255	1,440
From 1 - 5 Years	257,452	246
From 5 - 10 Years	61,547	1,686
Over 10 Years	1,360
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	210,095
12 Months or Longer	10,186
Total	$ 220,281
Number of Securities in a Continuous Loss Position	147
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 1,987
12 Months or Longer	208
Total	2,195
US Government-sponsored Enterprises Debt Securities [Member] | Collateralized Mortgage Backed Securities [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-for-Sale	163,515	162,740
U.S. Treasury and Agency Obligations [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-For-Sale Securities, at Amortized Cost	147,110	155,932
Available-for-Sale		155,782
Gross Unrealized Gains	304	264
Gross Unrealized Losses	37	414
Maturities of Debt Securities, at Amortized Cost:
Within One Year	0	76,802
From 1 - 5 Years	147,110	0
From 5 - 10 Years	0	76,802
Over 10 Years	0	0
Maturities of Debt Securities, at Fair Value:
Within One Year	0	413
From 1 - 5 Years	147,377	1
From 5 - 10 Years	0	414
Over 10 Years	0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	70,605
12 Months or Longer	0
Total	$ 70,605
Number of Securities in a Continuous Loss Position	19
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 37
12 Months or Longer	0
Total	37
U.S. Treasury and Agency Obligations [Member] | US Treasury Securities [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-For-Sale Securities, at Amortized Cost	54,701
Available-for-Sale	54,706
U.S. Treasury and Agency Obligations [Member] | Agency Securities [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-For-Sale Securities, at Amortized Cost	92,409	155,932
Available-for-Sale	92,671	155,782
State and Municipal Obligations [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-For-Sale Securities, at Amortized Cost	27,684	52,306
Gross Unrealized Gains	24	105
Gross Unrealized Losses	18	3
Maturities of Debt Securities, at Amortized Cost:
Within One Year	17,001	4,289
From 1 - 5 Years	9,615	1,443
From 5 - 10 Years	508	5,732
Over 10 Years	560	0
Maturities of Debt Securities, at Fair Value:
Within One Year	16,994	2
From 1 - 5 Years	9,628	1
From 5 - 10 Years	508	3
Over 10 Years	560
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	12,165
12 Months or Longer	7,377
Total	$ 19,542
Number of Securities in a Continuous Loss Position	84
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 13
12 Months or Longer	5
Total	18
Collateralized Mortgage Backed Securities [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-For-Sale Securities, at Amortized Cost	168,189	177,376
Gross Unrealized Gains	986	2,236
Gross Unrealized Losses	1,936	1,024
Maturities of Debt Securities, at Amortized Cost:
Within One Year	5,716	99,569
From 1 - 5 Years	101,008	903
From 5 - 10 Years	61,465	100,472
Over 10 Years	0	0
Maturities of Debt Securities, at Fair Value:
Within One Year	5,753	1,023
From 1 - 5 Years	100,447	1
From 5 - 10 Years	61,039	1,024
Over 10 Years	0
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	126,825
12 Months or Longer	0
Total	$ 126,825
Number of Securities in a Continuous Loss Position	40
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 1,936
12 Months or Longer	0
Total	1,936
Collateralized Mortgage Backed Securities [Member] | US Government-sponsored Enterprises Debt Securities [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-For-Sale Securities, at Amortized Cost	164,495	161,675
Collateralized Mortgage Backed Securities [Member] | Agency Securities [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-For-Sale Securities, at Amortized Cost	3,694	15,701
Available-for-Sale	3,724	15,848
Corporate and Other Debt Securities [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-For-Sale Securities, at Amortized Cost	3,512	14,544
Gross Unrealized Gains	0	0
Gross Unrealized Losses	204	245
Maturities of Debt Securities, at Amortized Cost:
Within One Year	2,512	3,616
From 1 - 5 Years	0	10,671
From 5 - 10 Years	0	14,287
Over 10 Years	1,000	0
Maturities of Debt Securities, at Fair Value:
Within One Year	2,508	2
From 1 - 5 Years	0	243
From 5 - 10 Years	0	245
Over 10 Years	800
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	500
12 Months or Longer	2,809
Total	$ 3,309
Number of Securities in a Continuous Loss Position	4
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 1
12 Months or Longer	203
Total	204
Mututal Funds and Equity Securities [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-For-Sale Securities, at Amortized Cost	1,120	1,120
Gross Unrealized Gains	262	112
Gross Unrealized Losses	0	0
Maturities of Debt Securities, at Amortized Cost:
Within One Year		0
From 1 - 5 Years		0
From 5 - 10 Years		0
Over 10 Years		0
Maturities of Debt Securities, at Fair Value:
Within One Year		0
From 1 - 5 Years		0
From 5 - 10 Years		0
Over 10 Years
Securities in a Continuous Loss Position, at Fair Value:
Less than 12 Months	0
12 Months or Longer	0
Total	$ 0
Number of Securities in a Continuous Loss Position	0
Unrealized Losses on Securities in a Continuous Loss Position:
Less than 12 Months	$ 0
12 Months or Longer	0
Total	0
Fair Value, Measurements, Recurring [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-for-Sale	346,996	402,309
Fair Value, Measurements, Recurring [Member] | U.S. Treasury and Agency Obligations [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-for-Sale	147,377
Fair Value, Measurements, Recurring [Member] | State and Municipal Obligations [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-for-Sale	27,690	52,408
Fair Value, Measurements, Recurring [Member] | Collateralized Mortgage Backed Securities [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-for-Sale	167,239	178,588
Fair Value, Measurements, Recurring [Member] | Corporate and Other Debt Securities [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-for-Sale	3,308	14,299
Fair Value, Measurements, Recurring [Member] | Mututal Funds and Equity Securities [Member]
Schedule of Available-for-sale Securities [Line Items]
Available-for-Sale	$ 1,382	$ 1,232