Investment Securities - Held-to-Maturity and Available-for-Sale, Scheduled Maturities (Details) - USD ($) $ in Thousands	Jun. 30, 2016	Dec. 31, 2015
Held-to-maturity Securities [Abstract]
Securities Held-to-Maturity, Amortized Cost	$ 32,885	$ 40,990
Securities Held-to-Maturity, Gross Unrealized Gains	69	135
Securities Held-to-Maturity, Gross Unrealized Losses	(8)	(64)
Securities Held-to-Maturity, Fair Value	32,946	41,061
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost	251,161	330,681
Securities Available-for-Sale, Gross Unrealized Gain	5,022	2,937
Securities Available-for-Sale, Gross Unrealized Loss	(2,088)	(3,848)
Securities Available-for-Sale, Fair Value	254,095	329,770
U.S. Treasuries [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	0	4,978
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	0	0
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	0	(91)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	0	4,887
Securities Available-for-Sale, Amortized Cost	0	4,978
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	0	0
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	0	(91)
Securities Available-for-Sale, Debt Securities, Fair Value	0	4,887
U.S. Government Corporations and Agencies [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, Within 1 year	10,067	10,389
Securities Available-for-Sale, Gross Unrealized Gains, Within 1 year	23	0
Securities Available-for-Sale, Gross Unrealized Losses, Within 1 year	0	(29)
Securities Available-for-Sale, Fair Value, Within 1 year	10,090	10,360
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	37,043	92,148
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	313	26
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	0	(378)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	37,356	91,796
Securities Available-for-Sale, Amortized Cost	47,110	102,537
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	336	26
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	0	(407)
Securities Available-for-Sale, Debt Securities, Fair Value	47,446	102,156
State and Political Subdivisions [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	16,818	17,362
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	150	80
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	(8)	(29)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	16,960	17,413
Securities Available-for-Sale, Amortized Cost, After 5 years to 10 years	50,727	47,969
Securities Available-for-Sale, Gross Unrealized Gains, After 5 years to 10 years	1,718	1,188
Securities Available-for-Sale, Gross Unrealized Losses, After 5 years to 10 years	(11)	(32)
Securities Available-for-Sale, Fair Value, After 5 years to 10 years	52,434	49,125
Securities Available-for-Sale, Amortized Cost, Over 10 years	28,133	34,334
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	1,340	1,160
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	0	0
Securities Available-for-Sale, Fair Value, Over 10 years	29,473	35,494
Securities Available-for-Sale, Amortized Cost	95,678	99,665
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	3,208	2,428
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	(19)	(61)
Securities Available-for-Sale, Debt Securities, Fair Value	98,867	102,032
Residential Mortgage Backed Securities [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	0	9,713
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	0	12
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	0	(13)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	0	9,712
Securities Available-for-Sale, Amortized Cost, After 5 years to 10 years	57	60
Securities Available-for-Sale, Gross Unrealized Gains, After 5 years to 10 years	1	0
Securities Available-for-Sale, Gross Unrealized Losses, After 5 years to 10 years	0	0
Securities Available-for-Sale, Fair Value, After 5 years to 10 years	58	60
Securities Available-for-Sale, Amortized Cost, Over 10 years	3,478	3,517
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	99	65
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	0	0
Securities Available-for-Sale, Fair Value, Over 10 years	3,577	3,582
Securities Available-for-Sale, Amortized Cost	3,535	13,290
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	100	77
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	0	(13)
Securities Available-for-Sale, Debt Securities, Fair Value	3,635	13,354
Collateralized Mortgage Obligations [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, Over 10 years	2,930	3,215
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	0	0
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	(2)	(82)
Securities Available-for-Sale, Fair Value, Over 10 years	2,928	3,133
Securities Available-for-Sale, Amortized Cost	2,930	3,215
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	0	0
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	(2)	(82)
Securities Available-for-Sale, Debt Securities, Fair Value	2,928	3,133
Corporate Bonds [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost, Within 1 year	250	250
Securities Available-for-Sale, Gross Unrealized Gains, Within 1 year	0	0
Securities Available-for-Sale, Gross Unrealized Losses, Within 1 year	0	0
Securities Available-for-Sale, Fair Value, Within 1 year	250	250
Securities Available-for-Sale, Amortized Cost, After 1 year to 5 years	19,032	19,446
Securities Available-for-Sale, Gross Unrealized Gains, After 1 year to 5 years	241	25
Securities Available-for-Sale, Gross Unrealized Losses, After 1 year to 5 years	(4)	(158)
Securities Available-for-Sale, Fair Value, After 1 year to 5 years	19,269	19,313
Securities Available-for-Sale, Amortized Cost, After 5 years to 10 years	15,204	10,148
Securities Available-for-Sale, Gross Unrealized Gains, After 5 years to 10 years	76	0
Securities Available-for-Sale, Gross Unrealized Losses, After 5 years to 10 years	(3)	(266)
Securities Available-for-Sale, Fair Value, After 5 years to 10 years	15,277	9,882
Securities Available-for-Sale, Amortized Cost, Over 10 years	60,000	60,000
Securities Available-for-Sale, Gross Unrealized Gains, Over 10 years	709	0
Securities Available-for-Sale, Gross Unrealized Losses, Over 10 years	(2,060)	(2,770)
Securities Available-for-Sale, Fair Value, Over 10 years	58,649	57,230
Securities Available-for-Sale, Amortized Cost	94,486	89,844
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	1,026	25
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	(2,067)	(3,194)
Securities Available-for-Sale, Debt Securities, Fair Value	93,445	86,675
Money Market Mutual Funds [Member]
Available-for-sale Securities [Abstract]
Securities Available-for-Sale, Amortized Cost	7,009	16,726
Securities Available-for-Sale, Debt Securities, Gross Unrealized Gain	0	0
Securities Available-for-Sale, Debt Securities, Gross Unrealized Losses	0	0
Securities Available-for-Sale, Debt Securities, Fair Value	7,009	16,726
Equity Securities [Member]
Available-for-sale Securities [Abstract]
Equity Securities Available-for-Sale, Amortized Cost	413	426
Equity Securities Available-for-Sale, Gross Unrealized Gains	352	381
Equity Securities Available-for-Sale, Gross Unrealized Loss	0	0
Equity Securities Available-for-Sale, Fair Value	765	807
Corporate Bonds [Member]
Held-to-maturity Securities [Abstract]
Securities Held-to-Maturity, Amortized Cost, Within 1 year	22,879	21,047
Securities Held-to-Maturity, Gross Unrealized Gains, Within 1 year	47	134
Securities Held-to-Maturity, Gross Unrealized Losses, Within 1 year	0	0
Securities Held-to-Maturity, Fair Value, Within 1 year	22,926	21,181
Securities Held-to-Maturity, Amortized Cost, After 1 year to 5 years	10,006	19,943
Securities Held-to-Maturity, Gross Unrealized Gains, After 1 year to 5 years	22	1
Securities Held-to-Maturity, Gross Unrealized Losses, After 1 year to 5 years	(8)	(64)
Securities Held-to-Maturity, Fair Value, After 1 year to 5 years	10,020	19,880
Securities Held-to-Maturity, Amortized Cost	32,885	40,990
Securities Held-to-Maturity, Gross Unrealized Gains	69	135
Securities Held-to-Maturity, Gross Unrealized Losses	(8)	(64)
Securities Held-to-Maturity, Fair Value	$ 32,946	$ 41,061