Junior Subordinated Debentures Legacy Banks' Trusts Terms (Details) (USD $)	Dec. 31, 2013	Dec. 31, 2012
Debt Instrument [Line Items]
Junior Subordinated Debenture Owed to Unconsolidated Subsidiary Trust	$ 106,363,000	$ 143,647,000
Gibraltar Financial Statutory Trust I [Member]
Debt Instrument [Line Items]
Debt Instrument, Face Amount		16,000,000
Junior Subordinated Debenture Owed to Unconsolidated Subsidiary Trust	0	16,495,000
Assets Held-in-trust		500,000
First State (CA) Statutory Trust I [Member]
Debt Instrument [Line Items]
Debt Instrument, Face Amount		6,000,000
Junior Subordinated Debenture Owed to Unconsolidated Subsidiary Trust	0	6,186,000
Assets Held-in-trust		200,000
Charter Financial Trust I [Member]
Debt Instrument [Line Items]
Debt Instrument, Face Amount		4,000,000
Junior Subordinated Debenture Owed to Unconsolidated Subsidiary Trust	0	4,124,000
Assets Held-in-trust		$ 100,000