Loans Receivable and Allowance for Loan Losses (Details 3) (USD $) In Thousands, unless otherwise specified	3 Months Ended		6 Months Ended
	Jun. 30, 2014	Jun. 30, 2013	Jun. 30, 2014	Jun. 30, 2013
Loans receivable and allowance for loan losses
Balance at the beginning of the period	$ 134,000	$ 144,250	$ 139,000	$ 145,501
Provision (credited) charged to operations	(5,742)	4,526	(4,111)	13,652
Charge-offs	(13,631)	(8,104)	(22,466)	(21,458)
Recoveries	3,973	3,228	6,177	6,205
Balance at the end of the period	118,600	143,900	118,600	143,900
Consumer and Other Loans
Loans receivable and allowance for loan losses
Balance at the beginning of the period	10,007	6,357	8,824	6,316
Provision (credited) charged to operations	(31)	1,357	1,950	2,201
Charge-offs	(527)	(222)	(1,424)	(1,128)
Recoveries	91	113	190	216
Balance at the end of the period	9,540	7,605	9,540	7,605
Mortgage Loans (Gross) | Residential
Loans receivable and allowance for loan losses
Balance at the beginning of the period	74,717	91,546	80,337	89,267
Provision (credited) charged to operations	(9,132)	(9,077)	(12,608)	(171)
Charge-offs	(12,834)	(6,459)	(16,927)	(14,772)
Recoveries	3,801	2,778	5,750	4,464
Balance at the end of the period	56,552	78,788	56,552	78,788
Mortgage Loans (Gross) | Multi-Family
Loans receivable and allowance for loan losses
Balance at the beginning of the period	34,578	33,952	36,703	35,514
Provision (credited) charged to operations	2,686	7,461	1,274	7,652
Charge-offs	(270)	(597)	(1,139)	(3,538)
Recoveries	81	49	237	1,237
Balance at the end of the period	37,075	40,865	37,075	40,865
Mortgage Loans (Gross) | Commercial Real Estate
Loans receivable and allowance for loan losses
Balance at the beginning of the period	14,698	12,395	13,136	14,404
Provision (credited) charged to operations	735	4,785	5,273	3,970
Charge-offs		(826)	(2,976)	(2,020)
Recoveries		288		288
Balance at the end of the period	$ 15,433	$ 16,642	$ 15,433	$ 16,642