Loans (Details 5) (USD $)	3 Months Ended
	Mar. 31, 2014	Mar. 31, 2013	Dec. 31, 2013
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	$ 7,769,000		$ 4,683,000
60-89 Days Past Due	5,697,000		6,502,000
90 Days or More Past Due	20,082,000		18,584,000
Total Past Due	33,548,000		29,769,000
Total Past Due, SBA guaranteed portions	10,800,000		12,600,000
Non-performing loans
Non-Accrual Loans	43,109,000		37,068,000
90 Days or More Past Due and Still Accruing			168,000
Total Non-Performing Loans	249,554,000		258,292,000
Additional interest income from non-accrual loans	0	0
Additional interest income that would have been recorded if nonperforming loans had been paid in accordance with their original terms	419,000	199,000
Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	4,806,000		2,014,000
60-89 Days Past Due	2,830,000		5,704,000
90 Days or More Past Due	16,312,000		16,840,000
Total Past Due	23,948,000		24,558,000
Non-performing loans
Non-Accrual Loans	31,439,000		28,627,000
Total Non-Performing Loans	168,023,000		172,204,000
Acquired Loans
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	2,963,000		2,669,000
60-89 Days Past Due	2,867,000		798,000
90 Days or More Past Due	3,770,000		1,744,000
Total Past Due	9,600,000		5,211,000
Non-performing loans
Non-Accrual Loans	11,670,000		8,441,000
90 Days or More Past Due and Still Accruing			168,000
Total Non-Performing Loans	81,531,000		86,088,000
Non-performing loans
Non-performing loans
Total Non-Performing Loans	43,109,000		37,236,000
Non-performing loans | Legacy Wilshire
Non-performing loans
Total Non-Performing Loans	31,439,000		28,627,000
Non-performing loans | Acquired Loans
Non-performing loans
Total Non-Performing Loans	11,670,000		8,609,000
Non-Accrual Loans
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	2,013,000		1,837,000
60-89 Days Past Due	4,171,000		3,975,000
90 Days or More Past Due	20,082,000		18,417,000
Total Past Due	26,266,000		24,229,000
Non-Accrual Loans | Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	1,062,000		615,000
60-89 Days Past Due	2,649,000		3,572,000
90 Days or More Past Due	16,312,000		16,841,000
Total Past Due	20,023,000		21,028,000
Non-Accrual Loans | Acquired Loans
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	951,000		1,222,000
60-89 Days Past Due	1,522,000		403,000
90 Days or More Past Due	3,770,000		1,576,000
Total Past Due	6,243,000		3,201,000
Construction | Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
90 Days or More Past Due			2,471,000
Total Past Due			2,471,000
Non-performing loans
Non-Accrual Loans			2,471,000
Total Non-Performing Loans			2,471,000
Construction | Non-performing loans | Legacy Wilshire
Non-performing loans
Total Non-Performing Loans			2,471,000
Real Estate Secured | Residential Real Estate | Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	177,000
60-89 Days Past Due			179,000
90 Days or More Past Due	451,000		617,000
Total Past Due	628,000		796,000
Non-performing loans
Non-Accrual Loans	1,030,000		1,050,000
Total Non-Performing Loans	3,063,000		2,508,000
Real Estate Secured | Residential Real Estate | Acquired Loans
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due			147,000
Total Past Due			147,000
Non-performing loans
Non-Accrual Loans	61,000		215,000
Total Non-Performing Loans	1,071,000		1,228,000
Real Estate Secured | Residential Real Estate | Non-performing loans | Legacy Wilshire
Non-performing loans
Total Non-Performing Loans	1,030,000		1,050,000
Real Estate Secured | Residential Real Estate | Non-performing loans | Acquired Loans
Non-performing loans
Total Non-Performing Loans	61,000		215,000
Real Estate Secured | SBA Real Estate | Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	350,000		394,000
60-89 Days Past Due	14,000		437,000
90 Days or More Past Due	363,000		597,000
Total Past Due	727,000		1,428,000
Non-performing loans
Non-Accrual Loans	1,129,000		958,000
Total Non-Performing Loans	8,086,000		9,924,000
Real Estate Secured | SBA Real Estate | Acquired Loans
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	422,000		225,000
60-89 Days Past Due	533,000
90 Days or More Past Due	1,227,000		528,000
Total Past Due	2,182,000		753,000
Non-performing loans
Non-Accrual Loans	2,048,000		811,000
Total Non-Performing Loans	8,103,000		6,755,000
Real Estate Secured | SBA Real Estate | Non-performing loans | Legacy Wilshire
Non-performing loans
Total Non-Performing Loans	1,129,000		958,000
Real Estate Secured | SBA Real Estate | Non-performing loans | Acquired Loans
Non-performing loans
Total Non-Performing Loans	2,048,000		811,000
Real Estate Secured | Gas Station | Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due			176,000
90 Days or More Past Due	842,000		849,000
Total Past Due	842,000		1,025,000
Non-performing loans
Non-Accrual Loans	1,018,000		1,026,000
Total Non-Performing Loans	8,059,000		8,122,000
Real Estate Secured | Gas Station | Acquired Loans
Non-accrual loans and loans 90 days or more past due and still accruing
90 Days or More Past Due	787,000
Total Past Due	787,000
Non-performing loans
Non-Accrual Loans	3,032,000		2,264,000
Total Non-Performing Loans	6,263,000		6,301,000
Real Estate Secured | Gas Station | Non-performing loans | Legacy Wilshire
Non-performing loans
Total Non-Performing Loans	1,018,000		1,026,000
Real Estate Secured | Gas Station | Non-performing loans | Acquired Loans
Non-performing loans
Total Non-Performing Loans	3,032,000		2,264,000
Real Estate Secured | Carwash | Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
90 Days or More Past Due	770,000		769,000
Total Past Due	770,000		769,000
Non-performing loans
Non-Accrual Loans	770,000		770,000
Total Non-Performing Loans	11,140,000		11,207,000
Real Estate Secured | Carwash | Acquired Loans
Non-accrual loans and loans 90 days or more past due and still accruing
90 Days or More Past Due			168,000
Total Past Due			168,000
Non-performing loans
90 Days or More Past Due and Still Accruing			168,000
Total Non-Performing Loans	12,897,000		13,691,000
Real Estate Secured | Carwash | Non-performing loans | Legacy Wilshire
Non-performing loans
Total Non-Performing Loans	770,000		770,000
Real Estate Secured | Carwash | Non-performing loans | Acquired Loans
Non-performing loans
Total Non-Performing Loans			168,000
Real Estate Secured | Hotel/Motel | Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
60-89 Days Past Due			810,000
90 Days or More Past Due	1,262,000		1,962,000
Total Past Due	1,262,000		2,772,000
Non-performing loans
Non-Accrual Loans	1,414,000		2,117,000
Total Non-Performing Loans	5,882,000		7,234,000
Real Estate Secured | Hotel/Motel | Acquired Loans
Non-performing loans
Non-Accrual Loans	752,000		760,000
Total Non-Performing Loans	8,899,000		10,635,000
Real Estate Secured | Hotel/Motel | Non-performing loans | Legacy Wilshire
Non-performing loans
Total Non-Performing Loans	1,414,000		2,117,000
Real Estate Secured | Hotel/Motel | Non-performing loans | Acquired Loans
Non-performing loans
Total Non-Performing Loans	752,000		760,000
Real Estate Secured | Other | Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	3,268,000		945,000
60-89 Days Past Due	881,000		4,221,000
90 Days or More Past Due	11,941,000		9,536,000
Total Past Due	16,090,000		14,702,000
Non-performing loans
Non-Accrual Loans	20,528,000		19,518,000
Total Non-Performing Loans	91,341,000		91,154,000
Real Estate Secured | Other | Acquired Loans
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	1,413,000		1,656,000
60-89 Days Past Due	1,245,000		388,000
90 Days or More Past Due	1,309,000		853,000
Total Past Due	3,967,000		2,897,000
Non-performing loans
Non-Accrual Loans	4,206,000		3,912,000
Total Non-Performing Loans	30,742,000		29,177,000
Real Estate Secured | Other | Non-performing loans | Legacy Wilshire
Non-performing loans
Total Non-Performing Loans	20,528,000		19,518,000
Real Estate Secured | Other | Non-performing loans | Acquired Loans
Non-performing loans
Total Non-Performing Loans	4,206,000		3,912,000
Real Estate Secured | Land | Legacy Wilshire
Non-performing loans
Total Non-Performing Loans	922,000		928,000
Commercial & Industrial | SBA Commercial
Non-performing loans
Total Non-Accrual Loans, SBA guaranteed portions	10,200,000		12,400,000
Commercial & Industrial | SBA Commercial | Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	378,000		458,000
60-89 Days Past Due			16,000
90 Days or More Past Due	8,000
Total Past Due	386,000		474,000
Non-performing loans
Non-Accrual Loans	133,000		137,000
Total Non-Performing Loans	3,257,000		3,138,000
Commercial & Industrial | SBA Commercial | Acquired Loans
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	270,000		287,000
60-89 Days Past Due			267,000
90 Days or More Past Due	16,000		17,000
Total Past Due	286,000		571,000
Non-performing loans
Non-Accrual Loans	58,000		69,000
Total Non-Performing Loans	1,902,000		2,575,000
Commercial & Industrial | SBA Commercial | Non-performing loans | Legacy Wilshire
Non-performing loans
Total Non-Performing Loans	133,000		137,000
Commercial & Industrial | SBA Commercial | Non-performing loans | Acquired Loans
Non-performing loans
Total Non-Performing Loans	58,000		69,000
Commercial & Industrial | Other Commercial | Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	633,000		41,000
60-89 Days Past Due	1,935,000
90 Days or More Past Due	675,000		39,000
Total Past Due	3,243,000		80,000
Non-performing loans
Non-Accrual Loans	5,417,000		580,000
Total Non-Performing Loans	36,271,000		35,516,000
Commercial & Industrial | Other Commercial | Acquired Loans
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due	858,000		344,000
60-89 Days Past Due	1,080,000		143,000
90 Days or More Past Due	431,000		178,000
Total Past Due	2,369,000		665,000
Non-performing loans
Non-Accrual Loans	1,513,000		410,000
Total Non-Performing Loans	11,503,000		15,571,000
Commercial & Industrial | Other Commercial | Non-performing loans | Legacy Wilshire
Non-performing loans
Total Non-Performing Loans	5,417,000		580,000
Commercial & Industrial | Other Commercial | Non-performing loans | Acquired Loans
Non-performing loans
Total Non-Performing Loans	1,513,000		410,000
Consumer | Legacy Wilshire
Non-accrual loans and loans 90 days or more past due and still accruing
60-89 Days Past Due			41,000
Total Past Due			41,000
Non-performing loans
Total Non-Performing Loans	2,000		2,000
Consumer | Acquired Loans
Non-accrual loans and loans 90 days or more past due and still accruing
30-59 Days Past Due			10,000
60-89 Days Past Due	9,000
Total Past Due	9,000		10,000
Non-performing loans
Total Non-Performing Loans	$ 151,000		$ 155,000