Loans Receivable and Allowance for Loan Losses (Details 5) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2012	Dec. 31, 2011
Credit quality tables for the non-covered loan portfolio
Total loans receivable	$ 976,134	$ 1,215,117
Commercial and Industrial [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	76,641	69,736
Commercial and Industrial [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	12,164	13,084
Commercial Real Estate [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	605,373	350,929
Commercial Real Estate [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	45,724	48,789
Construction [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	13,242	15,271
Construction [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	28,932	37,926
Residential Real Estate [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	107,855	53,476
Residential Real Estate [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	20,278	22,465
Consumer [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	2,451	2,211
Mortgage Warehouse [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	9,321	619,318
Manufactured Housing [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	158,457	104,565
Manufactured Housing [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	3,867	4,012
Pass/Satisfactory [Member] | Commercial and Industrial [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	72,052	61,851
Pass/Satisfactory [Member] | Commercial and Industrial [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	9,609	10,928
Pass/Satisfactory [Member] | Commercial Real Estate [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	561,061	307,734
Pass/Satisfactory [Member] | Commercial Real Estate [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	26,755	29,892
Pass/Satisfactory [Member] | Construction [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	10,515	9,314
Pass/Satisfactory [Member] | Construction [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	2,438	5,539
Pass/Satisfactory [Member] | Residential Real Estate [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	104,307	50,517
Pass/Satisfactory [Member] | Residential Real Estate [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	14,336	16,476
Special Mention [Member] | Commercial and Industrial [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	3,752	57
Special Mention [Member] | Commercial and Industrial [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	1,710	1,778
Special Mention [Member] | Commercial Real Estate [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	20,064	13,402
Special Mention [Member] | Commercial Real Estate [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	235	1,633
Special Mention [Member] | Construction [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	231	237
Special Mention [Member] | Construction [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	4,039	7,641
Special Mention [Member] | Residential Real Estate [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	1,229	0
Special Mention [Member] | Residential Real Estate [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	3,202	455
Substandard [Member] | Commercial and Industrial [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	837	7,506
Substandard [Member] | Commercial and Industrial [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	845	378
Substandard [Member] | Commercial Real Estate [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	23,487	28,131
Substandard [Member] | Commercial Real Estate [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	18,734	17,264
Substandard [Member] | Construction [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	2,044	4,349
Substandard [Member] | Construction [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	22,455	24,746
Substandard [Member] | Residential Real Estate [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	2,319	2,959
Substandard [Member] | Residential Real Estate [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	2,740	5,534
Doubtful [Member] | Commercial and Industrial [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	0	322
Doubtful [Member] | Commercial and Industrial [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	0	0
Doubtful [Member] | Commercial Real Estate [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	761	1,662
Doubtful [Member] | Commercial Real Estate [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	0	0
Doubtful [Member] | Construction [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	452	1,371
Doubtful [Member] | Construction [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	0	0
Doubtful [Member] | Residential Real Estate [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	0	0
Doubtful [Member] | Residential Real Estate [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	0	0
Performing [Member] | Consumer [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	2,398	2,171
Performing [Member] | Mortgage Warehouse [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	9,321	619,318
Performing [Member] | Manufactured Housing [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	158,457	104,565
Performing [Member] | Manufactured Housing [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	3,701	3,857
Nonperforming [Member] | Consumer [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	53	40
Nonperforming [Member] | Mortgage Warehouse [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	0	0
Nonperforming [Member] | Manufactured Housing [Member] | Non-covered loans [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	0	0
Nonperforming [Member] | Manufactured Housing [Member] | Covered loan [Member]
Credit quality tables for the non-covered loan portfolio
Total loans receivable	$ 166	$ 155