Description of Business and Summary of Significant Accounting Policies (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013 plan	Dec. 31, 2012	Dec. 31, 2011	Jun. 30, 2007	Jun. 30, 2004
Organization, Consolidation and Presentation of Financial Statements [Abstract]
FHLB stock	$ 1,600
Property, Plant and Equipment [Line Items]
Number of stock based compensation plans	1
Bank owned life insurance	17,836	17,704		5,000	10,000
Advertising costs	$ 524	$ 917	$ 1,100
Minimum [Member]
Property, Plant and Equipment [Line Items]
Period within which loans past due	30 days
Maximum [Member]
Property, Plant and Equipment [Line Items]
Period within which loans past due	89 days
Land Improvements [Member] | Minimum [Member]
Property, Plant and Equipment [Line Items]
Estimated useful lives	15 years
Land Improvements [Member] | Maximum [Member]
Property, Plant and Equipment [Line Items]
Estimated useful lives	40 years
Furniture and Fixtures [Member] | Minimum [Member]
Property, Plant and Equipment [Line Items]
Estimated useful lives	15 years
Furniture and Fixtures [Member] | Maximum [Member]
Property, Plant and Equipment [Line Items]
Estimated useful lives	25 years
Leasehold Improvements [Member] | Minimum [Member]
Property, Plant and Equipment [Line Items]
Estimated useful lives	3 years
Leasehold Improvements [Member] | Maximum [Member]
Property, Plant and Equipment [Line Items]
Estimated useful lives	7 years
City Bank [Member]
Property, Plant and Equipment [Line Items]
Number of pools for FDIC assisted acquisitions	18
North County Bank [Member]
Property, Plant and Equipment [Line Items]
Number of pools for FDIC assisted acquisitions	14
Stock Options [Member]
Property, Plant and Equipment [Line Items]
Stock option vesting period	5 years
Stock option exercise period	10 years