Business Segment Information (Details) (USD $)	3 Months Ended				6 Months Ended		9 Months Ended				12 Months Ended			24 Months Ended	36 Months Ended
	Sep. 30, 2013		Sep. 30, 2012		Dec. 31, 2010		Sep. 30, 2013 Segments		Sep. 30, 2012		Dec. 31, 2012		Dec. 31, 2011	Mar. 31, 2013	Sep. 30, 2013
Segment Reporting Information
Number of Reportable Segments							2
Segment Reporting Information, Profit (Loss)
Interest income	$ 18,470,000		$ 19,446,000				$ 55,396,000		$ 60,179,000
Interest expense	2,334,000		4,257,000				8,087,000		13,941,000
Net interest income	16,136,000		15,189,000				47,309,000		46,238,000
PROVISION FOR LOAN LOSSES	40,000		4,251,000				332,000		8,820,000
Net interest income (loss) after provision for loan losses	16,096,000		10,938,000				46,977,000		37,418,000
Other income	5,381,000		4,665,000				17,221,000		12,581,000
Other expense	14,150,000		14,792,000				42,207,000		44,102,000
Income (loss) before income taxes	7,327,000		811,000		37,000	[1]	21,991,000	[2]	5,897,000		(32,635,000)		(7,701,000)	37,000,000	(18,308,000)
Income taxes	2,616,000		54,000				7,822,000		(9,329,000)
Net income	4,711,000		757,000				14,169,000		15,226,000
Segment Reporting Information, Balance Sheet Data
Total assets	1,813,517,000						1,813,517,000				1,923,438,000	[3]			1,813,517,000
Net loans	1,312,423,000						1,312,423,000				1,284,355,000	[3]			1,312,423,000
Loans held for sale	12,632,000						12,632,000				27,679,000	[3]			12,632,000
Equity Method Investment, Other than Temporary Impairment	0		0				39,185		0
Bank Activities
Segment Reporting Information, Profit (Loss)
Interest income	18,375,000		19,238,000				55,033,000		59,641,000
Interest expense	2,157,000		3,985,000				7,527,000		13,215,000
Net interest income	16,218,000		15,253,000				47,506,000		46,426,000
PROVISION FOR LOAN LOSSES	40,000		4,254,000				332,000		8,842,000
Net interest income (loss) after provision for loan losses	16,178,000		10,999,000				47,174,000		37,584,000
Other income	3,645,000		3,060,000				9,626,000		8,134,000
Other expense	12,610,000		13,589,000				37,723,000		40,781,000
Income (loss) before income taxes	7,213,000		470,000				19,077,000		4,937,000
Income taxes	2,616,000		54,000				7,822,000		(9,329,000)
Net income	4,597,000		416,000				11,255,000		14,266,000
Segment Reporting Information, Balance Sheet Data
Total assets	1,793,225,000						1,793,225,000				1,890,906,000				1,793,225,000
Net loans	1,312,423,000						1,312,423,000				1,284,355,000				1,312,423,000
Loans held for sale	0						0				0				0
Mortgage Activities
Segment Reporting Information, Profit (Loss)
Interest income	95,000		208,000				363,000		538,000
Interest expense	0		61,000				0		90,000
Net interest income	95,000		147,000				363,000		448,000
PROVISION FOR LOAN LOSSES	0		(3,000)				0		(22,000)
Net interest income (loss) after provision for loan losses	95,000		150,000				363,000		470,000
Other income	1,713,000		1,599,000				7,545,000		4,412,000
Other expense	1,444,000		1,192,000				4,162,000		3,297,000
Income (loss) before income taxes	364,000		557,000				3,746,000		1,585,000
Income taxes	0		0				0		0
Net income	364,000		557,000				3,746,000		1,585,000
Segment Reporting Information, Balance Sheet Data
Total assets	17,923,000						17,923,000				31,500,000				17,923,000
Net loans	0						0				0				0
Loans held for sale	12,632,000						12,632,000				27,679,000				12,632,000
Other
Segment Reporting Information, Profit (Loss)
Interest income	0	[4]	0	[5]			0	[4]	0	[5]
Interest expense	177,000	[4]	211,000	[5]			560,000	[4]	636,000	[5]
Net interest income	(177,000)	[4]	(211,000)	[5]			(560,000)	[4]	(636,000)	[5]
PROVISION FOR LOAN LOSSES	0	[4]	0	[5]			0	[4]	0	[5]
Net interest income (loss) after provision for loan losses	(177,000)	[4]	(211,000)	[5]			(560,000)	[4]	(636,000)	[5]
Other income	23,000	[4]	6,000	[5]			50,000	[4]	35,000	[5]
Other expense	96,000	[4]	11,000	[5]			322,000	[4]	24,000	[5]
Income (loss) before income taxes	(250,000)	[4]	(216,000)	[5]			(832,000)	[4]	(625,000)	[5]
Income taxes	0	[4]	0	[5]			0	[4]	0	[5]
Net income	(250,000)	[4]	(216,000)	[5]			(832,000)	[4]	(625,000)	[5]
Segment Reporting Information, Balance Sheet Data
Total assets	2,369,000	[4]					2,369,000	[4]			1,032,000	[5]			2,369,000	[4]
Net loans	0	[4]					0	[4]			0	[5]			0	[4]
Loans held for sale	$ 0	[4]					$ 0	[4]			$ 0	[5]			$ 0	[4]

[1] 4th quarter of 2010

[2] First nine months of 2013

[3] Derived from audited consolidated financial statements

[4] (1)Included in this column are Holding Company assets and Holding Company income and expenses.

[5]