Derivative Financial Instruments, Effect on Statement of Operations (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended				6 Months Ended
	Jun. 30, 2014		Jun. 30, 2013		Jun. 30, 2014		Jun. 30, 2013
Cash Flow Hedge [Member]
Effect of derivative financial instruments on the condensed consolidated financial statements of operations [Abstract]
Gain (Loss) Recognized in Other Comprehensive Income (Loss) (Effective Portion)	$ 0		$ (35)		$ 0		$ (38)
Gain (Loss) Reclassified from Accumulated Other Comprehensive Loss into Income (Effective Portion)	(95)		(114)		(190)		(208)
Gain (Loss) Recognized in Income	0	[1]	0	[1]	0	[1]	0	[1]
Cash Flow Hedge [Member] | Fixed Income Interest Rate [Member] | Interest Rate Swap [Member]
Effect of derivative financial instruments on the condensed consolidated financial statements of operations [Abstract]
Gain (Loss) Recognized in Other Comprehensive Income (Loss) (Effective Portion)	0		(35)		0		(38)
Gain (Loss) Recognized in Income	0	[1]	0	[1]	0	[1]	0	[1]
Cash Flow Hedge [Member] | Fixed Income Interest Rate [Member] | Interest Rate Swap [Member] | Interest Expense [Member]
Effect of derivative financial instruments on the condensed consolidated financial statements of operations [Abstract]
Gain (Loss) Reclassified from Accumulated Other Comprehensive Loss into Income (Effective Portion)	(95)		(114)		(190)		(208)
No Hedge Designation [Member]
Effect of derivative financial instruments on the condensed consolidated financial statements of operations [Abstract]
Gain (Loss) Recognized in Income	19	[1]	1,422	[1]	(78)	[1]	104	[1]
No Hedge Designation [Member] | U.S. Treasury short position [Member] | Gain on securities [Member]
Effect of derivative financial instruments on the condensed consolidated financial statements of operations [Abstract]
Gain (Loss) Recognized in Income	52	[1]	0	[1]	52	[1]	0	[1]
No Hedge Designation [Member] | Rate-Lock Mortgage Loan Commitments [Member] | Net Mortgage Loan Gains [Member]
Effect of derivative financial instruments on the condensed consolidated financial statements of operations [Abstract]
Gain (Loss) Recognized in Income	238	[1]	(783)	[1]	224	[1]	(992)	[1]
No Hedge Designation [Member] | Mandatory Commitments to Sell Mortgage Loans [Member] | Net Mortgage Loan Gains [Member]
Effect of derivative financial instruments on the condensed consolidated financial statements of operations [Abstract]
Gain (Loss) Recognized in Income	(271)	[1]	2,185	[1]	(354)	[1]	2,121	[1]
No Hedge Designation [Member] | Amended Warrant [Member] | Increase in fair value of U.S. Treasury warrant [Member]
Effect of derivative financial instruments on the condensed consolidated financial statements of operations [Abstract]
Gain (Loss) Recognized in Income	0	[1]	20	[1]	0	[1]	(1,025)	[1]
No Hedge Designation [Member] | Variable Income Interest Rate [Member] | Interest Rate Swap [Member] | Interest Income [Member]
Effect of derivative financial instruments on the condensed consolidated financial statements of operations [Abstract]
Gain (Loss) Recognized in Income	99	[1]	0	[1]	99	[1]	0	[1]
No Hedge Designation [Member] | Fixed Income Interest Rate [Member] | Interest Rate Swap [Member] | Interest Income [Member]
Effect of derivative financial instruments on the condensed consolidated financial statements of operations [Abstract]
Gain (Loss) Recognized in Income	$ (99)	[1]	$ 0	[1]	$ (99)	[1]	$ 0	[1]

[1] For cash flow hedges, this location and amount refers to the ineffective portion.