Loans Receivable and Allowance for Loan Losses - Financing Receivable Credit Quality Indicators (Details) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Dec. 31, 2013
Financing Receivable, Recorded Investment [Line Items]
Loans	$ 5,348,316	$ 5,076,343
Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	5,013,588	4,720,493
Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	92,470	89,489
Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	236,975	258,500
Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	5,283	7,861
Real estate
Financing Receivable, Recorded Investment [Line Items]
Loans	4,184,298	3,904,058
Real estate | Residential
Financing Receivable, Recorded Investment [Line Items]
Loans	10,019	10,039
Real estate | Commercial
Financing Receivable, Recorded Investment [Line Items]
Loans	4,089,242	3,821,163
Real estate | Construction
Financing Receivable, Recorded Investment [Line Items]
Loans	85,037	72,856
Commercial business
Financing Receivable, Recorded Investment [Line Items]
Loans	929,143	949,093
Trade finance
Financing Receivable, Recorded Investment [Line Items]
Loans	141,053	124,685
Consumer and other
Financing Receivable, Recorded Investment [Line Items]
Loans	93,822	98,507
Legacy
Financing Receivable, Recorded Investment [Line Items]
Loans	4,529,895	4,097,662
Legacy | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	4,360,651	3,930,660
Legacy | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	55,659	46,480
Legacy | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	112,357	120,163
Legacy | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	1,228	359
Legacy | Real estate
Financing Receivable, Recorded Investment [Line Items]
Loans	3,524,636	3,126,101
Legacy | Real estate | Residential
Financing Receivable, Recorded Investment [Line Items]
Loans	8,804	8,070
Legacy | Real estate | Residential | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	8,804	8,070
Legacy | Real estate | Residential | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Real estate | Residential | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Real estate | Residential | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Real estate | Commercial | Retail
Financing Receivable, Recorded Investment [Line Items]
Loans	1,000,308	858,038
Legacy | Real estate | Commercial | Retail | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	984,293	842,815
Legacy | Real estate | Commercial | Retail | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	2,554	858
Legacy | Real estate | Commercial | Retail | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	13,461	14,365
Legacy | Real estate | Commercial | Retail | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Real estate | Commercial | Hotel & motel
Financing Receivable, Recorded Investment [Line Items]
Loans	678,007	583,765
Legacy | Real estate | Commercial | Hotel & motel | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	671,921	568,263
Legacy | Real estate | Commercial | Hotel & motel | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	116	1,841
Legacy | Real estate | Commercial | Hotel & motel | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	5,970	13,661
Legacy | Real estate | Commercial | Hotel & motel | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Real estate | Commercial | Gas station & car wash
Financing Receivable, Recorded Investment [Line Items]
Loans	504,259	466,059
Legacy | Real estate | Commercial | Gas station & car wash | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	493,778	455,205
Legacy | Real estate | Commercial | Gas station & car wash | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Real estate | Commercial | Gas station & car wash | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	10,481	10,854
Legacy | Real estate | Commercial | Gas station & car wash | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Real estate | Commercial | Mixed use
Financing Receivable, Recorded Investment [Line Items]
Loans	273,736	263,472
Legacy | Real estate | Commercial | Mixed use | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	271,096	259,788
Legacy | Real estate | Commercial | Mixed use | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	356	360
Legacy | Real estate | Commercial | Mixed use | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	2,284	3,324
Legacy | Real estate | Commercial | Mixed use | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Real estate | Commercial | Industrial & warehouse
Financing Receivable, Recorded Investment [Line Items]
Loans	323,675	268,165
Legacy | Real estate | Commercial | Industrial & warehouse | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	308,406	251,993
Legacy | Real estate | Commercial | Industrial & warehouse | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	3,144	4,116
Legacy | Real estate | Commercial | Industrial & warehouse | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	12,125	12,056
Legacy | Real estate | Commercial | Industrial & warehouse | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Real estate | Commercial | Other
Financing Receivable, Recorded Investment [Line Items]
Loans	650,810	605,675
Legacy | Real estate | Commercial | Other | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	632,297	589,895
Legacy | Real estate | Commercial | Other | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	6,929	3,928
Legacy | Real estate | Commercial | Other | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	11,584	11,493
Legacy | Real estate | Commercial | Other | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	359
Legacy | Real estate | Construction
Financing Receivable, Recorded Investment [Line Items]
Loans	85,037	72,857
Legacy | Real estate | Construction | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	83,449	71,231
Legacy | Real estate | Construction | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Real estate | Construction | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	1,588	1,626
Legacy | Real estate | Construction | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Commercial business
Financing Receivable, Recorded Investment [Line Items]
Loans	831,105	815,664
Legacy | Commercial business | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	769,907	759,956
Legacy | Commercial business | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	18,676	12,756
Legacy | Commercial business | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	41,294	42,952
Legacy | Commercial business | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	1,228	0
Legacy | Trade finance
Financing Receivable, Recorded Investment [Line Items]
Loans	137,915	122,941
Legacy | Trade finance | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	101,017	91,055
Legacy | Trade finance | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	23,844	22,589
Legacy | Trade finance | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	13,054	9,297
Legacy | Trade finance | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Legacy | Consumer and other
Financing Receivable, Recorded Investment [Line Items]
Loans	36,239	32,956
Legacy | Consumer and other | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	35,683	32,389
Legacy | Consumer and other | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	40	32
Legacy | Consumer and other | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	516	535
Legacy | Consumer and other | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired
Financing Receivable, Recorded Investment [Line Items]
Loans	818,421	978,681
Acquired | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	652,937	789,833
Acquired | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	36,811	43,009
Acquired | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	124,618	138,337
Acquired | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	4,055	7,502
Acquired | Real estate
Financing Receivable, Recorded Investment [Line Items]
Loans	659,662	777,957
Acquired | Real estate | Residential
Financing Receivable, Recorded Investment [Line Items]
Loans	1,215	1,969
Acquired | Real estate | Residential | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	807	1,066
Acquired | Real estate | Residential | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	295	284
Acquired | Real estate | Residential | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	113	619
Acquired | Real estate | Residential | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired | Real estate | Commercial | Retail
Financing Receivable, Recorded Investment [Line Items]
Loans	222,272	274,866
Acquired | Real estate | Commercial | Retail | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	184,448	237,325
Acquired | Real estate | Commercial | Retail | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	10,009	9,319
Acquired | Real estate | Commercial | Retail | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	27,815	28,128
Acquired | Real estate | Commercial | Retail | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	94
Acquired | Real estate | Commercial | Hotel & motel
Financing Receivable, Recorded Investment [Line Items]
Loans	124,156	131,287
Acquired | Real estate | Commercial | Hotel & motel | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	102,853	109,138
Acquired | Real estate | Commercial | Hotel & motel | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	7,100	7,134
Acquired | Real estate | Commercial | Hotel & motel | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	14,203	14,836
Acquired | Real estate | Commercial | Hotel & motel | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	179
Acquired | Real estate | Commercial | Gas station & car wash
Financing Receivable, Recorded Investment [Line Items]
Loans	40,297	51,662
Acquired | Real estate | Commercial | Gas station & car wash | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	28,600	35,356
Acquired | Real estate | Commercial | Gas station & car wash | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	346	1,621
Acquired | Real estate | Commercial | Gas station & car wash | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	11,100	14,440
Acquired | Real estate | Commercial | Gas station & car wash | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	251	245
Acquired | Real estate | Commercial | Mixed use
Financing Receivable, Recorded Investment [Line Items]
Loans	37,585	39,775
Acquired | Real estate | Commercial | Mixed use | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	32,090	32,992
Acquired | Real estate | Commercial | Mixed use | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	1,463	1,467
Acquired | Real estate | Commercial | Mixed use | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	4,032	5,316
Acquired | Real estate | Commercial | Mixed use | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired | Real estate | Commercial | Industrial & warehouse
Financing Receivable, Recorded Investment [Line Items]
Loans	97,592	115,815
Acquired | Real estate | Commercial | Industrial & warehouse | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	79,351	92,570
Acquired | Real estate | Commercial | Industrial & warehouse | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	1,460	3,525
Acquired | Real estate | Commercial | Industrial & warehouse | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	16,781	19,720
Acquired | Real estate | Commercial | Industrial & warehouse | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired | Real estate | Commercial | Other
Financing Receivable, Recorded Investment [Line Items]
Loans	136,545	162,583
Acquired | Real estate | Commercial | Other | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	113,330	133,752
Acquired | Real estate | Commercial | Other | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	5,756	6,698
Acquired | Real estate | Commercial | Other | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	16,885	21,573
Acquired | Real estate | Commercial | Other | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	574	560
Acquired | Real estate | Construction
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired | Real estate | Construction | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired | Real estate | Construction | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired | Real estate | Construction | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired | Real estate | Construction | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired | Commercial business
Financing Receivable, Recorded Investment [Line Items]
Loans	98,038	133,429
Acquired | Commercial business | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	63,976	94,854
Acquired | Commercial business | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	8,329	10,266
Acquired | Commercial business | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	24,194	26,245
Acquired | Commercial business | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	1,539	2,064
Acquired | Trade finance
Financing Receivable, Recorded Investment [Line Items]
Loans	3,138	1,744
Acquired | Trade finance | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	3,138	1,744
Acquired | Trade finance | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired | Trade finance | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired | Trade finance | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	0	0
Acquired | Consumer and other
Financing Receivable, Recorded Investment [Line Items]
Loans	57,583	65,551
Acquired | Consumer and other | Pass
Financing Receivable, Recorded Investment [Line Items]
Loans	44,344	51,036
Acquired | Consumer and other | Special Mention
Financing Receivable, Recorded Investment [Line Items]
Loans	2,053	2,695
Acquired | Consumer and other | Substandard
Financing Receivable, Recorded Investment [Line Items]
Loans	9,495	7,460
Acquired | Consumer and other | Doubtful or Loss
Financing Receivable, Recorded Investment [Line Items]
Loans	$ 1,691	$ 4,360