Loans Receivable and Allowance for Loan Losses (Details 9) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2013	Dec. 31, 2012
Financing Receivable, Impaired
Unpaid Principal Balance	$ 501,134	$ 457,440
Recorded Investment	393,677	346,906
Related Allowance	(21,033)	(5,046)
Net Investment	372,644	341,860
Residential | Full documentation interest-only loans
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	128,785	10,740
Unpaid Principal Balance, Loans without an allowance recorded	26,568	122,275
Recorded Investment, Loans with an allowance recorded	100,862	10,740
Recorded Investment, Loans without an allowance recorded	18,149	86,607
Related Allowance	(5,340)	(241)
Net Investment, Loans with an allowance recorded	95,522	10,499
Net Investment, Loans without an allowance recorded	18,149	86,607
Residential | Full documentation amortizing loans
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	31,008	6,122
Unpaid Principal Balance, Loans without an allowance recorded	8,333	23,489
Recorded Investment, Loans with an allowance recorded	27,241	6,122
Recorded Investment, Loans without an allowance recorded	5,936	17,962
Related Allowance	(1,817)	(347)
Net Investment, Loans with an allowance recorded	25,424	5,775
Net Investment, Loans without an allowance recorded	5,936	17,962
Residential | Reduced documentation interest-only loans
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	197,826	12,893
Unpaid Principal Balance, Loans without an allowance recorded		166,477
Recorded Investment, Loans with an allowance recorded	149,463	12,893
Recorded Investment, Loans without an allowance recorded		116,514
Related Allowance	(8,970)	(277)
Net Investment, Loans with an allowance recorded	140,493	12,616
Net Investment, Loans without an allowance recorded		116,514
Residential | Reduced documentation amortizing loans
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	30,342	3,889
Unpaid Principal Balance, Loans without an allowance recorded		23,419
Recorded Investment, Loans with an allowance recorded	24,818	3,889
Recorded Investment, Loans without an allowance recorded		17,419
Related Allowance	(2,918)	(136)
Net Investment, Loans with an allowance recorded	21,900	3,753
Net Investment, Loans without an allowance recorded		17,419
Multi-Family
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	15,677	19,704
Unpaid Principal Balance, Loans without an allowance recorded	37,556	44,341
Recorded Investment, Loans with an allowance recorded	15,677	19,704
Recorded Investment, Loans without an allowance recorded	30,974	36,412
Related Allowance	(1,194)	(2,576)
Net Investment, Loans with an allowance recorded	14,483	17,128
Net Investment, Loans without an allowance recorded	30,974	36,412
Commercial Real Estate
Financing Receivable, Impaired
Unpaid Principal Balance, Loans with an allowance recorded	8,444	10,835
Unpaid Principal Balance, Loans without an allowance recorded	16,595	13,256
Recorded Investment, Loans with an allowance recorded	8,444	10,835
Recorded Investment, Loans without an allowance recorded	12,113	7,809
Related Allowance	(794)	(1,469)
Net Investment, Loans with an allowance recorded	7,650	9,366
Net Investment, Loans without an allowance recorded	$ 12,113	$ 7,809