Quarterly Condensed Financial Information (Details) (USD $) In Thousands, except Per Share data, unless otherwise specified	3 Months Ended								9 Months Ended	12 Months Ended
	Dec. 31, 2013	Sep. 30, 2013	Jun. 30, 2013	Mar. 31, 2013	Dec. 31, 2012	Sep. 30, 2012	Jun. 30, 2012	Mar. 31, 2012	Sep. 30, 2012	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Organization, Consolidation and Presentation of Financial Statements [Abstract]
Interest and Fee Income, Loans and Leases	$ 36,435	$ 36,883	$ 38,061	$ 41,910	$ 45,346	$ 42,874	$ 40,029	$ 37,215		$ 153,289	$ 165,464	$ 142,840
Interest Expense	4,064	4,309	4,753	5,011	5,295	5,390	5,896	6,586		18,137	23,167	30,155
Net interest income (expense)	32,371	32,574	33,308	36,899	40,051	37,484	34,133	30,629		135,152	142,297	112,685
Provision for loan losses not covered under FDIC loss share	2,452	(652)	(4,295)	1,853	5,916	1,048	75	1,718		(642)	8,757	13,300
Provision for loan losses covered under FDIC loss share	2,185	2,811	(2,278)	2,256	653	10,889	206	2,285		4,974	14,033	2,803
Interest Income (Expense), after Provision for Loan Loss	27,734	30,415	39,881	32,790	33,482	25,547	33,852	26,626		130,820	119,507	96,582
Noninterest Income	4,946	3,716	(1,677)	2,914	(3,576)	7,832	845	3,983		9,899	9,084	18,508
Noninterest Expense	28,199	21,008	21,147	20,285	22,389	21,053	21,185	21,134		90,639	85,761	76,865
Income (Loss) from Continuing Operations before Equity Method Investments, Income Taxes, Extraordinary Items, Noncontrolling Interest	4,481	13,123	17,057	15,419	7,517	12,326	13,512	9,475		50,080	42,830	38,225
Income tax expense	860	4,713	6,024	5,379	2,102	4,396	4,746	3,290		16,976	14,534	12,802
Net income	3,621	8,410	11,033	10,040	5,415	7,930	8,766	6,185	28,296	33,104	28,296	25,423
Net income available to common shareholders	$ 3,621	$ 8,410	$ 11,033	$ 10,040	$ 4,153	$ 7,282	$ 8,122	$ 5,544	$ 25,101	$ 33,104	$ 25,101	$ 22,899
Basic	$ 0.19	$ 0.45	$ 0.61	$ 0.56	$ 0.23	$ 0.41	$ 0.46	$ 0.31	$ 1.41	$ 1.78	$ 1.41	$ 1.37
Diluted earnings per common share: (in dollars per share)	$ 0.18	$ 0.44	$ 0.58	$ 0.53	$ 0.23	$ 0.39	$ 0.44	$ 0.31	$ 1.37	$ 1.73	$ 1.37	$ 1.34