Investment Securities (Details 3) (USD $)	12 Months Ended
	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010	Dec. 13, 2012 SAVB Capital Trust I and II	Dec. 31, 2011 Federal Reserve Bank stock	Dec. 31, 2012 Federal Home Loan Bank stock	Dec. 31, 2011 Federal Home Loan Bank stock	Dec. 31, 2012 Investment in unconsolidated subsidiaries	Dec. 31, 2011 Investment in unconsolidated subsidiaries
Other investment securities
Amortized Cost	$ 9,768,000	$ 18,292,000		$ 310,000	$ 7,028,000	$ 8,126,000	$ 9,932,000	$ 1,642,000	$ 1,332,000
Fair Value	9,768,000	18,292,000			7,028,000	8,126,000	9,932,000	1,642,000	1,332,000
Amortized Cost
Due in one year or less	732,000
Due after one year through five years	1,451,000
Due after five years through ten years	9,256,000
Due after ten years	4,001,000
Total	15,440,000
Fair Value
Due in one year or less	741,000
Due after one year through five years	1,487,000
Due after five years through ten years	9,922,000
Due after ten years	4,403,000
Fair Value	16,553,000	17,864,000
Amortized Cost
Due in one year or less	3,660,000
Due after one year through five years	16,396,000
Due after five years through ten years	93,240,000
Due after ten years	407,530,000
Total	520,826,000	279,689,000
Fair Value
Due in one year or less	3,685,000
Due after one year through five years	16,720,000
Due after five years through ten years	95,712,000
Due after ten years	418,766,000
Fair Value	534,883,000	289,195,000
Information with respect to sales of available-for-sale securities
Sales Proceed	29,301,000	52,282,000	45,030,000
Gross realized gains	193,000	517,000	1,559,000
Gross realized losses	(4,000)	(194,000)	(1,267,000)
Net realized gain (loss)	$ 189,000	$ 323,000	$ 292,000