Investment Securities (Narrative) (Details) (USD $)	3 Months Ended		12 Months Ended
	Dec. 31, 2013 security	Sep. 30, 2013	Dec. 31, 2013 security	Dec. 31, 2012	Dec. 31, 2011
Schedule of Available-for-sale Securities [Line Items]
Carrying value of securities pledged	$ 315,530,000		$ 315,530,000	$ 357,520,000
Number of securities held to maturity with unrealized losses	0		0
Securities classified as trading	0		0	0
Impairment charge			166,000	0	65,000
Securities available for sale, at fair value	252,513,000		252,513,000	508,681,000
Securities held to maturity, fair value	137,087,000		137,087,000	454,000
Securities transferred from available-for-sale to held-to-maturity category, amortized cost	152,890,000	152,890,000	152,887,000	0	0
Securities transferred from available-for-sale to held-to-maturity category, fair value	147,450,000	147,450,000
Securities transferred from available-for-sale to held-to-maturity category, unrealized holding loss	3,530,000	3,530,000	3,533,000	0	0
Securities transferred from available-for-sale to held-to-maturity category, remaining unamortized loss			5,070,000
Securities transferred from available-for-sale to held-to-maturity category, remaining unamortized loss, net of tax			6,311,000	336,000	(2,590,000)
Investment in FHLBB stock	7,496,000		7,496,000	8,145,000
Transferred From Available-For-Sale to Held-To-Maturity [Member]
Schedule of Available-for-sale Securities [Line Items]
Securities transferred from available-for-sale to held-to-maturity category, remaining unamortized loss, net of tax			3,300,000
CLOs [Member]
Schedule of Available-for-sale Securities [Line Items]
Securities available for sale, at fair value	37,907,000		37,907,000	24,527,000
Securities sold, book value	17,740,000		17,740,000
Unrealized Gains (Losses) on Securities [Member] | Transferred From Available-For-Sale to Held-To-Maturity [Member]
Schedule of Available-for-sale Securities [Line Items]
Securities transferred from available-for-sale to held-to-maturity category, unrealized holding loss			3,533,000
Securities transferred from available-for-sale to held-to-maturity category, remaining unamortized loss, net of tax			$ 3,296,000