Covered Assets and FDIC Indemnification Asset (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		9 Months Ended
	Sep. 30, 2013	Sep. 30, 2012	Sep. 30, 2013	Sep. 30, 2012	Dec. 31, 2012
Covered loans [Line Items]
Covered loans	$ 171,416		$ 171,416		$ 217,339
Subtotal	194,236		194,236		264,515
Fair value discount	(22,820)		(22,820)		(47,176)
Allowance for loan losses	(15,026)		(15,026)		(3,252)
Total covered loans, net	156,390		156,390		214,087
Other Real Estate, Covered [Roll Forward]
Balance, beginning of period	12,927	23,000	13,460	26,622
Additions to covered OREO	282	1,305	7,585	8,478
Dispositions of covered OREO, net	(8,909)	(5,391)	(15,550)	(13,387)
Valuation adjustments	(191)	(103)	(1,386)	(2,902)
Balance, end of period	4,109	18,811	4,109	18,811
FDIC Indemnification Asset [Roll Forward]
Balance, beginning of period	32,832	54,867	34,571	65,586
Change in FDIC indemnification asset	(1,030)	(2,762)	6,298	(8,898)
Reduction due to loans paid in full	(4,155)	(545)	(6,756)	(4,169)
Transfers to (due from) FDIC	(2,208)	(6,847)	(8,674)	(7,806)
Balance, end of period	25,439	44,713	25,439	44,713
City Bank [Member]
Covered loans [Line Items]
Covered loans	106,884		106,884		140,777
Subtotal	118,849		118,849		169,757
Fair value discount	(11,965)		(11,965)		(28,980)
Allowance for loan losses	(12,772)		(12,772)		(2,727)
Total covered loans, net	94,112		94,112		138,050
Certain Loans Acquired in Transfer Accounted for as Debt Securities, Accretable Yield Movement Schedule [Roll Forward]
Balance at beginning of period	29,223	63,623	49,168	78,004
Accretion to interest income	(3,023)	(5,247)	(10,791)	(16,552)
Disposals	(4,927)	(1,718)	(11,555)	(4,441)
Reclassifications (to) from nonaccretable difference	0	0	(5,549)	(353)
Balance at end of period	21,273	56,658	21,273	56,658
Other Real Estate, Covered [Roll Forward]
Balance, beginning of period	9,125	13,580	7,399	19,341
Additions to covered OREO	0	561	6,777	1,517
Dispositions of covered OREO, net	(5,653)	(4,579)	(10,130)	(9,338)
Valuation adjustments	0	0	(574)	(1,958)
Balance, end of period	3,472	9,562	3,472	9,562
FDIC Indemnification Asset [Roll Forward]
Balance, beginning of period	21,979	37,587	20,390	43,235
Change in FDIC indemnification asset	(689)	(2,510)	4,994	(8,273)
Reduction due to loans paid in full	(3,784)	(415)	(5,194)	(1,739)
Transfers to (due from) FDIC	(1,687)	(5,154)	(4,371)	(3,715)
Balance, end of period	15,819	29,508	15,819	29,508
North County Bank [Member]
Covered loans [Line Items]
Covered loans	64,532		64,532		76,562
Subtotal	75,387		75,387		94,758
Fair value discount	(10,855)		(10,855)		(18,196)
Allowance for loan losses	(2,254)		(2,254)		(525)
Total covered loans, net	62,278		62,278		76,037
Certain Loans Acquired in Transfer Accounted for as Debt Securities, Accretable Yield Movement Schedule [Roll Forward]
Balance at beginning of period	15,999	26,845	19,567	29,574
Accretion to interest income	(2,354)	(3,694)	(7,343)	(11,443)
Disposals	(400)	(2,796)	(2,845)	(5,517)
Reclassifications (to) from nonaccretable difference	0	4	3,866	7,745
Balance at end of period	13,245	20,359	13,245	20,359
Other Real Estate, Covered [Roll Forward]
Balance, beginning of period	3,802	9,420	6,061	7,281
Additions to covered OREO	282	744	808	6,961
Dispositions of covered OREO, net	(3,256)	(812)	(5,420)	(4,049)
Valuation adjustments	(191)	(103)	(812)	(944)
Balance, end of period	637	9,249	637	9,249
FDIC Indemnification Asset [Roll Forward]
Balance, beginning of period	10,853	17,280	14,181	22,351
Change in FDIC indemnification asset	(341)	(252)	1,304	(625)
Reduction due to loans paid in full	(371)	(130)	(1,562)	(2,430)
Transfers to (due from) FDIC	(521)	(1,693)	(4,303)	(4,091)
Balance, end of period	9,620	15,205	9,620	15,205
Commercial [Member]
Covered loans [Line Items]
Covered loans	21,037		21,037		29,011
Commercial [Member] | City Bank [Member]
Covered loans [Line Items]
Covered loans	10,169		10,169		13,863
Commercial [Member] | North County Bank [Member]
Covered loans [Line Items]
Covered loans	10,868		10,868		15,148
Real Estate Mortgage [Member]
Covered loans [Line Items]
Covered loans	147,261		147,261		198,778
Real Estate Mortgage [Member] | City Bank [Member]
Covered loans [Line Items]
Covered loans	94,637		94,637		136,063
Real Estate Mortgage [Member] | North County Bank [Member]
Covered loans [Line Items]
Covered loans	52,624		52,624		62,715
Real Estate Mortgage [Member] | One to Four Family Residential [Member]
Covered loans [Line Items]
Covered loans	11,130		11,130		14,195
Real Estate Mortgage [Member] | One to Four Family Residential [Member] | City Bank [Member]
Covered loans [Line Items]
Covered loans	2,663		2,663		3,783
Real Estate Mortgage [Member] | One to Four Family Residential [Member] | North County Bank [Member]
Covered loans [Line Items]
Covered loans	8,467		8,467		10,412
Real Estate Mortgage [Member] | Multi Family and Commercial [Member]
Covered loans [Line Items]
Covered loans	136,131		136,131		184,583
Real Estate Mortgage [Member] | Multi Family and Commercial [Member] | City Bank [Member]
Covered loans [Line Items]
Covered loans	91,974		91,974		132,280
Real Estate Mortgage [Member] | Multi Family and Commercial [Member] | North County Bank [Member]
Covered loans [Line Items]
Covered loans	44,157		44,157		52,303
Real Estate Construction [Member]
Covered loans [Line Items]
Covered loans	18,423		18,423		26,507
Real Estate Construction [Member] | City Bank [Member]
Covered loans [Line Items]
Covered loans	11,934		11,934		17,133
Real Estate Construction [Member] | North County Bank [Member]
Covered loans [Line Items]
Covered loans	6,489		6,489		9,374
Real Estate Construction [Member] | One to Four Family Residential [Member]
Covered loans [Line Items]
Covered loans	6,251		6,251		7,764
Real Estate Construction [Member] | One to Four Family Residential [Member] | City Bank [Member]
Covered loans [Line Items]
Covered loans	4,185		4,185		4,764
Real Estate Construction [Member] | One to Four Family Residential [Member] | North County Bank [Member]
Covered loans [Line Items]
Covered loans	2,066		2,066		3,000
Real Estate Construction [Member] | Multi Family and Commercial [Member]
Covered loans [Line Items]
Covered loans	12,172		12,172		18,743
Real Estate Construction [Member] | Multi Family and Commercial [Member] | City Bank [Member]
Covered loans [Line Items]
Covered loans	7,749		7,749		12,369
Real Estate Construction [Member] | Multi Family and Commercial [Member] | North County Bank [Member]
Covered loans [Line Items]
Covered loans	4,423		4,423		6,374
Consumer [Member] | Direct Consumer Loan [Member]
Covered loans [Line Items]
Covered loans	7,515		7,515		10,219
Consumer [Member] | Direct Consumer Loan [Member] | City Bank [Member]
Covered loans [Line Items]
Covered loans	2,109		2,109		2,698
Consumer [Member] | Direct Consumer Loan [Member] | North County Bank [Member]
Covered loans [Line Items]
Covered loans	$ 5,406		$ 5,406		$ 7,521