Investment Securities - Gross Realized Gains and Losses - (Details) $ in Thousands	3 Months Ended
	Mar. 31, 2017 USD ($) item	Mar. 31, 2016 USD ($)	Dec. 31, 2016 USD ($) item
Gross realized gains and losses on the sale of securities recognized in earnings [Abstract]
Gross realized gains	$ 0	$ 367
Gross realized losses	0	0
Net realized gains	0	367
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	81,402		$ 84,780
12 months or longer, Fair value	14,984		14,359
Total, Fair value	96,386		99,139
Less than 12 months, Gross unrealized losses	(995)		(1,800)
12 months or longer, Gross unrealized losses	(518)		(529)
Total, Gross unrealized losses	$ (1,513)		$ (2,329)
Less than 12 months, number of positions | item	38		40
12 months or longer, number of positions | item	8		7
Total , number of positions | item	46		47
Fair value	$ 163,737		$ 169,854
Number of securities in an unrealized loss position for less than twelve months | item	38		40
Number of securities in an unrealized loss position for more than twelve months | item	8		7
Credit related impairment losses on debt securities held for which a portion of OTTI was recognized in other comprehensive income [Roll Forward]
Reductions for securities sold during the period (realized)	$ 0	$ 0
U.S. Government Agencies [Member]
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	2,100		$ 966
12 months or longer, Fair value	0		0
Total, Fair value	2,100		966
Less than 12 months, Gross unrealized losses	(26)		(22)
12 months or longer, Gross unrealized losses	0		0
Total, Gross unrealized losses	$ (26)		$ (22)
Less than 12 months, number of positions | item	2		1
12 months or longer, number of positions | item	0		0
Total , number of positions | item	2		1
Fair value	$ 2,100		$ 966
Number of securities in an unrealized loss position for less than twelve months | item	2		1
Number of securities in an unrealized loss position for more than twelve months | item	0		0
Mortgage-backed Securities-residential [Member]
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value			$ 4,237
12 months or longer, Fair value			0
Total, Fair value			4,237
Less than 12 months, Gross unrealized losses			(17)
12 months or longer, Gross unrealized losses			0
Total, Gross unrealized losses			$ (17)
Less than 12 months, number of positions | item			2
12 months or longer, number of positions | item			0
Total , number of positions | item			2
Fair value	$ 6,662		$ 7,038
Number of securities in an unrealized loss position for less than twelve months | item			2
Number of securities in an unrealized loss position for more than twelve months | item			0
Collateralized Mortgage Obligations, Issued or Guaranteed by U.S. Government Agencies [Member]
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	74,956		$ 73,864
12 months or longer, Fair value	11,654		12,045
Total, Fair value	86,610		85,909
Less than 12 months, Gross unrealized losses	(896)		(1,630)
12 months or longer, Gross unrealized losses	(456)		(499)
Total, Gross unrealized losses	$ (1,352)		$ (2,129)
Less than 12 months, number of positions | item	31		31
12 months or longer, number of positions | item	4		4
Total , number of positions | item	35		35
Fair value	$ 138,980		$ 145,559
Number of securities in an unrealized loss position for less than twelve months | item	31		31
Number of securities in an unrealized loss position for more than twelve months | item	4		4
Mortgage-backed Securities, Issued by Private Enterprises [Member]
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	$ 3,681		$ 4,035
12 months or longer, Fair value	0		0
Total, Fair value	3,681		4,035
Less than 12 months, Gross unrealized losses	(71)		(86)
12 months or longer, Gross unrealized losses	0		0
Total, Gross unrealized losses	$ (71)		$ (86)
Less than 12 months, number of positions | item	3		3
12 months or longer, number of positions | item	0		0
Total , number of positions | item	3		3
Fair value	$ 3,681		$ 4,035
Number of securities in an unrealized loss position for less than twelve months | item	3		3
Number of securities in an unrealized loss position for more than twelve months | item	0		0
Corporate Bonds [Member]
Available for sale securities, continuous unrealized loss position [Abstract]
Fair value	$ 1,725		$ 1,701
Municipal Bonds [Member]
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	665		1,678
12 months or longer, Fair value	3,330		2,314
Total, Fair value	3,995		3,992
Less than 12 months, Gross unrealized losses	(2)		(45)
12 months or longer, Gross unrealized losses	(62)		(30)
Total, Gross unrealized losses	$ (64)		$ (75)
Less than 12 months, number of positions | item	2		3
12 months or longer, number of positions | item	4		3
Total , number of positions | item	6		6
Fair value	$ 8,742		$ 8,708
Number of securities in an unrealized loss position for less than twelve months | item	2		3
Number of securities in an unrealized loss position for more than twelve months | item	4		3
Private Equity Funds [Member]
Available for sale securities, continuous unrealized loss position [Abstract]
Fair value	$ 1,821		$ 1,821
Common Stock
Available for sale securities, continuous unrealized loss position [Abstract]
Fair value	$ 26		$ 26