Parent Company Only Financial Information (Details 2) (USD $) In Thousands, unless otherwise specified	3 Months Ended								12 Months Ended
	Dec. 31, 2012	Sep. 30, 2012	Jun. 30, 2012	Mar. 31, 2012	Dec. 31, 2011	Sep. 30, 2011	Jun. 30, 2011	Mar. 31, 2011	Dec. 31, 2012	Dec. 31, 2011	Dec. 31, 2010
Dividends from subsidiaries:
Other income	$ 17,613	$ 15,589	$ 15,770	$ 17,880	$ 15,012	$ 14,718	$ 13,746	$ 15,539	$ 66,852	$ 59,015	$ 62,753
Expense:
Interest expense	2,955	3,466	3,951	4,398	4,751	5,084	6,032	6,559	14,770	22,426	39,032
Income tax benefit	(2,556)	(2,331)	(1,877)	(3,733)	(2,753)	(4,151)	(3,955)	(4,111)	(10,497)	(14,970)	(9,464)
Distributions less than (in excess of) net income (loss) of subsidiaries:
Net income	4,917	4,909	4,888	7,643	5,746	7,570	7,447	9,110	22,357	29,873	23,230
Parent
Dividends from subsidiaries:
Non-bank									2,500	3,750	1,900
Interest and dividend income									49	63	27
Other income									6,231	2,424	2,743
Total operating income									8,780	6,237	4,670
Expense:
Salaries and employee benefits									4,718	3,620	2,595
Interest expense									1,351	1,963	3,197
Operating expense									2,469	2,623	2,612
Total expense									8,538	8,206	8,404
Income (loss) before income taxes benefit and distributions less than (in excess of) net income of subsidiaries									242	(1,969)	(3,734)
Income tax benefit									1,155	2,556	2,530
Income before distributions less than (in excess of) net income of subsidiaries									1,397	587	(1,204)
Distributions less than (in excess of) net income (loss) of subsidiaries:
Bank									20,097	29,941	23,051
Non-bank									863	(655)	1,383
Net income									$ 22,357	$ 29,873	$ 23,230