Portfolio Loans - Summary of Recorded Investment in Portfolio Loans by Class and Category Based on Impairment Method (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013	Dec. 31, 2012
Loans - Ending Balance:
Portfolio loans, including unearned loan fees	$ 2,750,737	$ 2,433,916
Non-Covered Loans
Balance December 31, 2015
Individually evaluated for impairment	2,335	2,394
Collectively evaluated for impairment	31,106	27,791
Total	33,441	30,185	$ 27,289	$ 34,330
Loans - Ending Balance:
Individually evaluated for impairment	10,878	24,366
Collectively evaluated for impairment	2,739,859	2,409,550
Total	2,750,446	2,433,021
Portfolio loans, including unearned loan fees	2,750,737	2,433,916
Provision for Loan, Lease, and Other Losses	4,872	4,409	(642)
Financing Receivable, Allowance for Credit Losses, Write-downs	(6,091)	(5,556)	(10,378)
Financing Receivable, Allowance for Credit Losses, Recovery	4,475	4,043	3,979
Non-Covered Loans | Commercial and industrial
Balance December 31, 2015
Individually evaluated for impairment	1,953	704
Collectively evaluated for impairment	20,103	16,279
Total	22,056	16,983	12,246	10,064
Loans - Ending Balance:
Individually evaluated for impairment	4,514	5,998
Collectively evaluated for impairment	1,479,813	1,258,489
Total	1,484,327	1,264,487
Provision for Loan, Lease, and Other Losses	6,976	6,707	3,810
Financing Receivable, Allowance for Credit Losses, Write-downs	3,699	3,738	3,404
Financing Receivable, Allowance for Credit Losses, Recovery	1,796	1,768	1,776
Non-Covered Loans | CRE - owner occupied
Balance December 31, 2015
Individually evaluated for impairment	0	0
Collectively evaluated for impairment	3,484	4,382
Total	3,484	4,382	6,600	10,403
Loans - Ending Balance:
Individually evaluated for impairment	921	5,036
Collectively evaluated for impairment	427,143	391,715
Total	428,064	396,751
Provision for Loan, Lease, and Other Losses	(303)	(2,063)	(94)
Financing Receivable, Allowance for Credit Losses, Write-downs	(664)	250	4,441
Financing Receivable, Allowance for Credit Losses, Recovery	69	95	732
Non-Covered Loans | CRE - investor owned
Balance December 31, 2015
Individually evaluated for impairment	6	0
Collectively evaluated for impairment	2,963	3,135
Total	2,969	3,135	4,096	4,192
Loans - Ending Balance:
Individually evaluated for impairment	1,962	2,618
Collectively evaluated for impairment	340,997	341,385
Total	342,959	344,003
Provision for Loan, Lease, and Other Losses	(1,626)	(1,517)	410
Financing Receivable, Allowance for Credit Losses, Write-downs	38	450	550
Financing Receivable, Allowance for Credit Losses, Recovery	1,498	1,006	44
Non-Covered Loans | Construction and land development
Balance December 31, 2015
Individually evaluated for impairment	369	352
Collectively evaluated for impairment	1,335	1,363
Total	1,704	1,715	2,136	5,239
Loans - Ending Balance:
Individually evaluated for impairment	2,800	6,866
Collectively evaluated for impairment	158,261	137,012
Total	161,061	143,878
Provision for Loan, Lease, and Other Losses	(335)	(322)	(2,695)
Financing Receivable, Allowance for Credit Losses, Write-downs	350	905	896
Financing Receivable, Allowance for Credit Losses, Recovery	674	806	488
Non-Covered Loans | Residential real estate
Balance December 31, 2015
Individually evaluated for impairment	7	1,052
Collectively evaluated for impairment	1,789	1,778
Total	1,796	2,830	2,019	2,026
Loans - Ending Balance:
Individually evaluated for impairment	681	3,082
Collectively evaluated for impairment	195,817	182,170
Total	196,498	185,252
Provision for Loan, Lease, and Other Losses	(58)	525	107
Financing Receivable, Allowance for Credit Losses, Write-downs	1,313	48	1,053
Financing Receivable, Allowance for Credit Losses, Recovery	337	334	939
Non-Covered Loans | Consumer and other
Balance December 31, 2015
Individually evaluated for impairment	0	286
Collectively evaluated for impairment	1,432	854
Total	1,432	1,140	192	31
Loans - Ending Balance:
Individually evaluated for impairment	0	766
Collectively evaluated for impairment	137,828	98,779
Total	137,537	98,650
Portfolio loans, including unearned loan fees	137,828	99,545
Provision for Loan, Lease, and Other Losses	218	1,079	195
Financing Receivable, Allowance for Credit Losses, Write-downs	27	165	34
Financing Receivable, Allowance for Credit Losses, Recovery	101	34	0
Non-Covered Loans | Unallocated
Balance December 31, 2015
Total	0	0	0	$ 2,375
Loans - Ending Balance:
Provision for Loan, Lease, and Other Losses	0	0	(2,375)
Financing Receivable, Allowance for Credit Losses, Write-downs	0	0	0
Financing Receivable, Allowance for Credit Losses, Recovery	$ 0	$ 0	$ 0