Income Taxes - Income Tax Reconciliation (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Income Tax Disclosure [Abstract]
Effective Income Tax Rate Reconciliation, at Federal Statutory Income Tax Rate	35.00%	35.00%
Tax benefit at statutory rate on income before income taxes	$ 10,230	$ (11,422)
Tax-exempt interest on investments	(1,055)	(737)
State income tax, net of federal benefits	1,604	(1,298)
Income from bank-owned life insurance	(210)	(221)
Valuation allowance on deferred tax assets	0	(11,000)
Other	(168)	717
Total income taxes	$ 10,401	$ (23,961)	$ 6,694