Loans Receivable and Allowance for Loan Losses (Details 4) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Loans receivable and allowance for loan losses
Balance at the beginning of the period	$ 145,501	$ 157,185	$ 201,499
Provision charged to operations	19,601	40,400	37,000
Charge-offs	(37,040)	(61,217)	(92,797)
Recoveries	10,938	9,133	11,483
Balance at the end of the period	139,000	145,501	157,185
Consumer and Other Loans
Loans receivable and allowance for loan losses
Balance at the beginning of the period	6,316	3,800	4,146
Provision charged to operations	3,604	4,538	1,182
Charge-offs	(1,916)	(2,541)	(1,665)
Recoveries	820	519	137
Balance at the end of the period	8,824	6,316	3,800
Mortgage Loans (Gross) | Residential
Loans receivable and allowance for loan losses
Balance at the beginning of the period	89,267	105,991	125,524
Provision charged to operations	9,368	24,663	34,457
Charge-offs	(26,644)	(49,794)	(64,834)
Recoveries	8,346	8,407	10,844
Balance at the end of the period	80,337	89,267	105,991
Mortgage Loans (Gross) | Multi-Family
Loans receivable and allowance for loan losses
Balance at the beginning of the period	35,514	35,422	56,266
Provision charged to operations	4,684	6,161	814
Charge-offs	(4,732)	(6,275)	(22,160)
Recoveries	1,237	206	502
Balance at the end of the period	36,703	35,514	35,422
Mortgage Loans (Gross) | Commercial Real Estate
Loans receivable and allowance for loan losses
Balance at the beginning of the period	14,404	11,972	15,563
Provision charged to operations	1,945	5,038	547
Charge-offs	(3,748)	(2,607)	(4,138)
Recoveries	535	1
Balance at the end of the period	$ 13,136	$ 14,404	$ 11,972