Loans Receivable and Allowance for Loan Losses (Details 9) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2013	Dec. 31, 2012
Financing Receivable, Impaired
Unpaid Principal Balance	$ 486,261	$ 457,440
Recorded Investment	386,040	346,906
Related Allowance	(24,766)	(5,046)
Net Investment	361,274	341,860
Residential | Full documentation interest-only loans
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	149,386	10,740
Unpaid Principal Balance, Loans without an allowance recorded		122,275
Recorded Investment, Loans with an allowance recorded	114,923	10,740
Recorded Investment, Loans without an allowance recorded		86,607
Related Allowance	(7,797)	(241)
Net Investment, Loans with an allowance recorded	107,126	10,499
Net Investment, Loans without an allowance recorded		86,607
Residential | Full documentation amortizing loans
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	40,794	6,122
Unpaid Principal Balance, Loans without an allowance recorded		23,489
Recorded Investment, Loans with an allowance recorded	35,014	6,122
Recorded Investment, Loans without an allowance recorded		17,962
Related Allowance	(2,550)	(347)
Net Investment, Loans with an allowance recorded	32,464	5,775
Net Investment, Loans without an allowance recorded		17,962
Residential | Reduced documentation interest-only loans
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	183,353	12,893
Unpaid Principal Balance, Loans without an allowance recorded		166,477
Recorded Investment, Loans with an allowance recorded	139,472	12,893
Recorded Investment, Loans without an allowance recorded		116,514
Related Allowance	(9,564)	(277)
Net Investment, Loans with an allowance recorded	129,908	12,616
Net Investment, Loans without an allowance recorded		116,514
Residential | Reduced documentation amortizing loans
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	29,062	3,889
Unpaid Principal Balance, Loans without an allowance recorded		23,419
Recorded Investment, Loans with an allowance recorded	24,086	3,889
Recorded Investment, Loans without an allowance recorded		17,419
Related Allowance	(2,354)	(136)
Net Investment, Loans with an allowance recorded	21,732	3,753
Net Investment, Loans without an allowance recorded		17,419
Multi-Family
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	23,437	19,704
Unpaid Principal Balance, Loans without an allowance recorded	38,635	44,341
Recorded Investment, Loans with an allowance recorded	23,437	19,704
Recorded Investment, Loans without an allowance recorded	31,954	36,412
Related Allowance	(2,179)	(2,576)
Net Investment, Loans with an allowance recorded	21,258	17,128
Net Investment, Loans without an allowance recorded	31,954	36,412
Commercial Real Estate
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	6,764	10,835
Unpaid Principal Balance, Loans without an allowance recorded	14,830	13,256
Recorded Investment, Loans with an allowance recorded	6,764	10,835
Recorded Investment, Loans without an allowance recorded	10,390	7,809
Related Allowance	(322)	(1,469)
Net Investment, Loans with an allowance recorded	6,442	9,366
Net Investment, Loans without an allowance recorded	$ 10,390	$ 7,809