Investment Securities - Amortized Cost and Fair Value (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2013	Dec. 31, 2012
Schedule of Available-for-sale Securities
Amortized Cost, Total available-for-sale securities	$ 330,619	$ 336,349
Unrealized Gains	4,885	7,766
Unrealized Losses	6,814	995
Fair Value, Total available-for-sale securities	328,690	343,120	[1]
Securities of U.S. government agencies
Schedule of Available-for-sale Securities
Amortized Cost, Within 1 year	1,698	10,005
Amortized Cost, After 1 but within 5 years	15,041	17,479
Amortized Cost	16,739	27,484
Unrealized Gains	0	44
Unrealized Losses	203	1
Fair Value, Within 1 year	1,690	10,020
Fair Value, After 1 but within 5 years	14,846	17,507
Fair Value	16,536	27,527
Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Amortized Cost, Within 1 year	0	119
Amortized Cost, After 1 but within 5 years	214	315
Amortized Cost, After 5 but within 10 years	16,231	10,371
Amortized Cost, After 10 years	102,464	94,319
Amortized Cost	118,909	105,124
Unrealized Gains	924	2,458
Unrealized Losses	1,265	325
Fair Value, Within 1 year	0	121
Fair Value, After 1 but within 5 years	225	341
Fair Value, After 5 but within 10 years	16,498	10,712
Fair Value, After 10 years	101,845	96,083
Fair Value	118,568	107,257
Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Amortized Cost, After 1 but within 5 years	3,435	648
Amortized Cost, After 5 but within 10 years	5,323	9,975
Amortized Cost, After 10 years	60,171	111,155
Amortized Cost	68,929	121,778
Unrealized Gains	789	1,110
Unrealized Losses	226	295
Fair Value, After 1 but within 5 years	3,429	650
Fair Value, After 5 but within 10 years	5,474	10,178
Fair Value, After 10 years	60,589	111,765
Fair Value	69,492	122,593
Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Amortized Cost, After 5 but within 10 years	151	178
Amortized Cost, After 10 years	11,457	848
Amortized Cost	11,608	1,026
Unrealized Gains	21	19
Unrealized Losses	197	0
Fair Value, After 5 but within 10 years	151	178
Fair Value, After 10 years	11,281	867
Fair Value	11,432	1,045
State and municipal securities
Schedule of Available-for-sale Securities
Amortized Cost, Within 1 year	1,061	620
Amortized Cost, After 1 but within 5 years	6,376	5,734
Amortized Cost, After 5 but within 10 years	38,790	24,464
Amortized Cost, After 10 years	66,338	50,031
Amortized Cost	112,565	80,849
Unrealized Gains	1,984	4,089
Unrealized Losses	4,923	373
Fair Value, Within 1 year	1,081	626
Fair Value, After 1 but within 5 years	6,656	6,055
Fair Value, After 5 but within 10 years	39,347	26,150
Fair Value, After 10 years	62,542	51,734
Fair Value	109,626	84,565
Common and preferred stocks
Schedule of Available-for-sale Securities
Amortized Cost, Common and preferred stocks	1,869	88
Unrealized Gains	1,167	46
Unrealized Losses	0	1
Fair Value, Common and preferred stocks	3,036	133
Within 1 year | Securities of U.S. government agencies
Schedule of Available-for-sale Securities
Unrealized Gains	0	15
Unrealized Losses	8	0
Within 1 year | Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Unrealized Gains	0	2
Unrealized Losses	0	0
Within 1 year | State and municipal securities
Schedule of Available-for-sale Securities
Unrealized Gains	20	6
Unrealized Losses	0	0
After 1 but within 5 years | Securities of U.S. government agencies
Schedule of Available-for-sale Securities
Unrealized Gains	0	29
Unrealized Losses	195	1
After 1 but within 5 years | Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Unrealized Gains	11	26
Unrealized Losses	0	0
After 1 but within 5 years | Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	0	2
Unrealized Losses	6	0
After 1 but within 5 years | State and municipal securities
Schedule of Available-for-sale Securities
Unrealized Gains	280	321
Unrealized Losses	0	0
After 5 but within 10 years | Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Unrealized Gains	267	341
Unrealized Losses	0	0
After 5 but within 10 years | Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	152	206
Unrealized Losses	1	3
After 5 but within 10 years | Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	0	0
Unrealized Losses	0	0
After 5 but within 10 years | State and municipal securities
Schedule of Available-for-sale Securities
Unrealized Gains	1,227	1,698
Unrealized Losses	670	12
After 10 years | Government sponsored agencies - Residential mortgage-backed securities
Schedule of Available-for-sale Securities
Unrealized Gains	646	2,089
Unrealized Losses	1,265	325
After 10 years | Government sponsored agencies - Collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	637	902
Unrealized Losses	219	292
After 10 years | Private label collateralized mortgage obligations
Schedule of Available-for-sale Securities
Unrealized Gains	21	19
Unrealized Losses	197	0
After 10 years | State and municipal securities
Schedule of Available-for-sale Securities
Unrealized Gains	457	2,064
Unrealized Losses	$ 4,253	$ 361

[1] Derived from audited consolidated financial statements