Investment Securities - Investments in continuous loss position (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2013	Dec. 31, 2012
Schedule of Available-for-sale Securities
Less Than 12 Months, Fair value	$ 169,030	$ 64,766
Less Than 12 Months, Unrealized losses	6,773	826
12 Months or More, Fair value	2,419	7,864
12 Months or More, Unrealized losses	41	169
Total, Fair value	171,449	72,630
Total, Unrealized losses	6,814	995
U.S. government agencies
Schedule of Available-for-sale Securities
Less Than 12 Months, Fair value	16,536	2,429
Less Than 12 Months, Unrealized losses	203	1
12 Months or More, Fair value	0	0
12 Months or More, Unrealized losses	0	0
Total, Fair value	16,536	2,429
Total, Unrealized losses	203	1
Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Less Than 12 Months, Fair value	63,785	12,021
Less Than 12 Months, Unrealized losses	1,265	325
12 Months or More, Fair value	0	0
12 Months or More, Unrealized losses	0	0
Total, Fair value	63,785	12,021
Total, Unrealized losses	1,265	325
Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions	1	3
Less Than 12 Months, Fair value	18,213	27,417
Less Than 12 Months, Unrealized losses	185	127
12 Months or More, Fair value	2,268	7,626
12 Months or More, Unrealized losses	41	168
Total, Fair value	20,481	35,043
Total, Unrealized losses	226	295
Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions	1	1
Less Than 12 Months, Fair value	6,095	0
Less Than 12 Months, Unrealized losses	197	0
12 Months or More, Fair value	151	178
12 Months or More, Unrealized losses	0	0
Total, Fair value	6,246	178
Total, Unrealized losses	197	0
State and municipal securities
Schedule of Available-for-sale Securities
Less Than 12 Months, Fair value	64,401	22,899
Less Than 12 Months, Unrealized losses	4,923	373
12 Months or More, Fair value	0	0
12 Months or More, Unrealized losses		0
Total, Fair value	64,401	22,899
Total, Unrealized losses	4,923	373
Common and preferred stocks
Schedule of Available-for-sale Securities
Available-for-sale, Securities in Unrealized Loss Positions, Qualitative Disclosure, Number of Positions		2
Less Than 12 Months, Fair value		0
Less Than 12 Months, Unrealized losses		0
12 Months or More, Fair value		60
12 Months or More, Unrealized losses		1
Total, Fair value		60
Total, Unrealized losses		$ 1