Fair Value Measurements (Details 2) (USD $)	3 Months Ended
	Mar. 31, 2014	Mar. 31, 2015	Oct. 02, 2014
Loans held for sale
Rollforward for financial instruments measured at fair value using Level 3 inputs
Balance, beginning of Period	$ 27,729,000
Purchases/Additions	4,900,000
Sales/Reductions	(5,594,000)
Total gains or losses (realized or unrealized):
Included in Net Income (Loss)	(209,000)
Balance, end of Period	26,826,000
SWS
Total gains or losses (realized or unrealized):
Aggregate principal amount of senior unsecured loan			50,000,000
Level 3
Rollforward for financial instruments measured at fair value using Level 3 inputs
Balance, beginning of Period	102,331,000	45,172,000
Purchases/Additions	12,332,000	21,127,000
Sales/Reductions	(5,594,000)	(271,000)
Total gains or losses (realized or unrealized):
Included in Net Income (Loss)	2,392,000	(8,953,000)
Included in other comprehensive income (loss)	3,452,000
Balance, end of Period	114,913,000	57,075,000
Level 3 | Trading securities.
Rollforward for financial instruments measured at fair value using Level 3 inputs
Purchases/Additions		7,301,000
Total gains or losses (realized or unrealized):
Included in Net Income (Loss)		(1,369,000)
Balance, end of Period		5,932,000
Level 3 | Available for sale securities
Rollforward for financial instruments measured at fair value using Level 3 inputs
Balance, beginning of Period	60,053,000
Total gains or losses (realized or unrealized):
Included in Net Income (Loss)	593,000
Included in other comprehensive income (loss)	3,452,000
Balance, end of Period	64,098,000
Level 3 | Loans held for sale
Rollforward for financial instruments measured at fair value using Level 3 inputs
Balance, beginning of Period		9,017,000
Purchases/Additions		11,136,000
Sales/Reductions		(271,000)
Total gains or losses (realized or unrealized):
Included in Net Income (Loss)		(387,000)
Balance, end of Period		19,495,000
Level 3 | MSR
Rollforward for financial instruments measured at fair value using Level 3 inputs
Balance, beginning of Period	20,149,000	36,155,000
Purchases/Additions	7,432,000	2,690,000
Total gains or losses (realized or unrealized):
Included in Net Income (Loss)	2,358,000	(7,197,000)
Balance, end of Period	29,939,000	31,648,000
Level 3 | Derivative Liabilities
Rollforward for financial instruments measured at fair value using Level 3 inputs
Balance, beginning of Period	(5,600,000)
Total gains or losses (realized or unrealized):
Included in Net Income (Loss)	(350,000)
Balance, end of Period	$ (5,950,000)