Income Taxes Components of Deferred Tax Assets and Liabilities (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Income Taxes [Abstract]
Deferred Tax Assets, Tax Deferred Expense, Reserves and Accruals, Provision for Loan Losses	$ 36,634	$ 41,218
Deferred Tax Assets, Tax Deferred Expense, Reserves and Accruals, Loss Reserves	896	930
Deferred Tax Assets, Tax Deferred Expense, Compensation and Benefits, Share-based Compensation Cost	9,258	11,336
Deferred Tax Assets, Goodwill and Intangible Assets	0	944
Deferred Tax Assets, Tax Deferred Expense, Compensation and Benefits, Employee Compensation	14,436	11,347
Deferred Tax Assets, Operating Loss Carryforwards, State and Local	346	781
Deferred Tax Assets, Capital Loss Carryforwards	2,165	2,381
Deferred Tax Assets, Investments	489	899
Deferred Tax Assets, Deferred Income	1,902	3,094
Deferred Tax Assets, Unrealized Losses on Available-for-Sale Securities, Gross	2,619	0
Deferred Tax Assets, Other	2,320	2,716
Deferred Tax Assets, Gross	71,065	75,646
Deferred Tax Assets, Valuation Allowance	2,000	2,232
Deferred Tax Assets, Net of Valuation Allowance	69,065	73,414
Deferred Tax Liabilities, Other Comprehensive Income	0	1,228
Deferred Tax Liabilities, Tax Deferred Income	7,168	7,072
Deferred Tax Liabilities, Goodwill and Intangible Assets	2,673	0
Deferred Tax Liabilities, Property, Plant and Equipment	674	211
Deferred Tax Liabilities, Other	3,186	2,658
Deferred Tax Liabilities, Gross	13,701	11,169
Deferred Tax Assets, Net	$ 55,364	$ 62,245