Investment Securities - Maturities (Details) - USD ($) $ in Thousands	Mar. 31, 2016	Dec. 31, 2015
Available-for-Sale, Amortized Cost
Due within one year	$ 22,647
Due from one to five years	158,647
Due from five to ten years	127,994
Due after ten years	0
Available-for-sale, amortized cost	309,288
Amortized Cost	346,084	$ 377,267
Available-for-Sale, Fair Value
Due within one year	22,759
Due from one to five years	161,011
Due from five to ten years	130,320
Due after ten years	0
Available-for-sale, fair value	314,090
Available-for-sale, at fair value	351,101	377,978
Held-to-Maturity, Amortized Cost
Due within one year	3,859
Due from one to five years	4,021
Due from five to ten years	10,732
Due after ten years	17,893
Amortized Cost	36,505	22,633
Held-to-Maturity, Amortized Cost	36,505
Held-to-Maturity, Fair Value
Due within one year	3,866
Due from one to five years	4,010
Due from five to ten years	10,781
Due after ten years	18,291
Fair Value	36,948	22,630
Available-for-sale Securities Pledged as Collateral	226,644	215,952
U.S. Agency mortgage-backed securities [Member]
Available-for-Sale, Amortized Cost
Amortized Cost	33,561	29,608
Available-for-Sale, Fair Value
Available-for-sale, at fair value	33,768	29,378
Held-to-Maturity, Amortized Cost
Held-to-Maturity, Amortized Cost	0
Held-to-Maturity, Fair Value
Fair Value	0
Mutual funds [Member]
Available-for-Sale, Amortized Cost
Amortized Cost	2,527	2,517
Available-for-Sale, Fair Value
Available-for-sale, at fair value	2,492	2,466
Held-to-Maturity, Amortized Cost
Held-to-Maturity, Amortized Cost	0
Held-to-Maturity, Fair Value
Fair Value	0
Trust preferred securities [Member]
Available-for-Sale, Amortized Cost
Amortized Cost	49	49
Available-for-Sale, Fair Value
Available-for-sale, at fair value	49	50
Held-to-Maturity, Amortized Cost
Held-to-Maturity, Amortized Cost	0
Held-to-Maturity, Fair Value
Fair Value	0
Equity securities [Member]
Available-for-Sale, Amortized Cost
Amortized Cost	659	659
Available-for-Sale, Fair Value
Available-for-sale, at fair value	702	$ 680
Held-to-Maturity, Amortized Cost
Held-to-Maturity, Amortized Cost	0
Held-to-Maturity, Fair Value
Fair Value	$ 0