Covered Assets and Indemnification Asset - Impaired Loans (Details) - Covered - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2016	Mar. 31, 2015	Dec. 31, 2015
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	$ 444,199		$ 481,103
Recorded Investment with No Allowance	184,587		190,022
Recorded Investment with Allowance	17,366		36,145
Total Recorded Investment	201,953		226,167
Related Allowance	1,168		1,500
Average investment in covered impaired loans
Average investment	214,062	$ 401,391
Covered, Nonaccrual Loans
Non-accrual loans	3,576		8,978
Secured
Average investment in covered impaired loans
Average investment	5,509	13,170
Covered, Nonaccrual Loans
Non-accrual loans	60		68
Unsecured
Average investment in covered impaired loans
Average investment	1,786	5,851
Secured by commercial properties
Average investment in covered impaired loans
Average investment	92,941	203,506
Covered, Nonaccrual Loans
Non-accrual loans	433		442
Secured by residential properties
Average investment in covered impaired loans
Average investment	95,788	135,164
Covered, Nonaccrual Loans
Non-accrual loans	2,550		2,516
Residential construction loans
Average investment in covered impaired loans
Average investment	673	1,336
Covered, Nonaccrual Loans
Non-accrual loans	520		541
Commercial construction loans and land development
Average investment in covered impaired loans
Average investment	17,365	$ 42,364
Covered, Nonaccrual Loans
Non-accrual loans	13		5,411
PCI loans
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	438,957		475,846
Recorded Investment with No Allowance	180,499		185,829
Recorded Investment with Allowance	17,366		36,145
Total Recorded Investment	197,865		221,974
Related Allowance	1,168		1,500
Covered, Nonaccrual Loans
Non-accrual loans	0		5,300
PCI loans | Secured
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	13,790		15,454
Recorded Investment with No Allowance	1,680		3,312
Recorded Investment with Allowance	3,483		2,415
Total Recorded Investment	5,163		5,727
Related Allowance	361		495
PCI loans | Unsecured
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	8,757		9,377
Recorded Investment with No Allowance	1,145		618
Recorded Investment with Allowance	645		1,162
Total Recorded Investment	1,790		1,780
Related Allowance	61		246
PCI loans | Secured by commercial properties
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	197,972		211,145
Recorded Investment with No Allowance	77,867		67,540
Recorded Investment with Allowance	10,210		29,388
Total Recorded Investment	88,077		96,928
Related Allowance	189		245
PCI loans | Secured by residential properties
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	172,472		182,698
Recorded Investment with No Allowance	86,001		93,438
Recorded Investment with Allowance	2,863		3,180
Total Recorded Investment	88,864		96,618
Related Allowance	522		514
PCI loans | Residential construction loans
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	1,223		1,225
Recorded Investment with No Allowance			121
Recorded Investment with Allowance	165
Total Recorded Investment	165		121
Related Allowance	35
PCI loans | Commercial construction loans and land development
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	44,743		55,947
Recorded Investment with No Allowance	13,806		20,800
Total Recorded Investment	13,806		20,800
Loans excluding PCI Loans
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	5,242		5,257
Recorded Investment with No Allowance	4,088		4,193
Total Recorded Investment	4,088		4,193
Loans excluding PCI Loans | Secured
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	72		78
Recorded Investment with No Allowance	60		68
Total Recorded Investment	60		68
Loans excluding PCI Loans | Unsecured
Impaired Financing Receivable, Recorded Investment [Abstract]
Recorded Investment with No Allowance			1
Total Recorded Investment			1
Loans excluding PCI Loans | Secured by commercial properties
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	508		512
Recorded Investment with No Allowance	433		443
Total Recorded Investment	433		443
Loans excluding PCI Loans | Secured by residential properties
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	3,827		3,745
Recorded Investment with No Allowance	3,062		3,031
Total Recorded Investment	3,062		3,031
Loans excluding PCI Loans | Residential construction loans
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	787		799
Recorded Investment with No Allowance	520		540
Total Recorded Investment	520		540
Loans excluding PCI Loans | Commercial construction loans and land development
Impaired Financing Receivable, Recorded Investment [Abstract]
Unpaid Contractual Principal Balance	48		123
Recorded Investment with No Allowance	13		110
Total Recorded Investment	$ 13		$ 110