Consolidated Statements of Changes in Shareholders' Equity (USD $) In Thousands, except Share data, unless otherwise specified	Total	Common Stock	Treasury Stock	Additional Paid-In Capital	Retained Earnings	Accumulated Other Comprehensive Income (Loss)
Beginning Balance at Dec. 31, 2010	$ 469,509	$ 133,579	$ (27,187)	$ 217,011	$ 162,547	$ (16,441)
Beginning Balance (shares) at Dec. 31, 2010		25,043,112
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income	25,632				25,632
Changes in other comprehensive income (loss)	8,294					8,294
Comprehensive income	33,926
Cash dividends ($0.68 per share)	(17,071)				(17,071)
Issuance of common stock for stock-based compensation awards	(218)		(372)	154
Issuance of common stock for stock-based compensation awards (shares)		22,956
Stock-based compensation expense	620			620
Ending Balance at Dec. 31, 2011	487,202	133,579	(26,815)	217,477	171,108	(8,147)
Ending Balance (shares) at Dec. 31, 2011		25,066,068
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income	26,637				26,637
Changes in other comprehensive income (loss)	(354)					(354)
Comprehensive income	26,283
Cash dividends ($0.68 per share)	(17,117)				(17,117)
Issuance of common stock for stock-based compensation awards	(472)		(1,189)	717
Issuance of common stock for stock-based compensation awards (shares)		91,569
Stock-based compensation expense	1,368			1,368
Ending Balance at Dec. 31, 2012	498,208	133,579	(25,626)	218,128	180,628	(8,501)
Ending Balance (shares) at Dec. 31, 2012		25,157,637
Increase (Decrease) in Stockholders' Equity [Roll Forward]
Net income	33,487				33,487
Changes in other comprehensive income (loss)	(3,472)					(3,472)
Comprehensive income	30,015
Cash dividends ($0.68 per share)	(19,303)				(19,303)
Common stock issued in connection with the acquisition of First M&F Corp.	155,524	29,702	4,074	121,748
Common stock issued in connection with the acquisition of First M&F Corp. (shares)		6,175,576
Purchase of treasury stock related to stock-based compensation awards	(1,496)		(1,496)
Purchase of treasury stock related to stock-based compensation awards (shares)		(59,342)
Issuance of common stock for stock-based compensation awards	105		(25)	130
Issuance of common stock for stock-based compensation awards (shares)		113,797
Stock-based compensation expense	2,806			2,806
Other, net	3				3
Ending Balance at Dec. 31, 2013	$ 665,652	$ 163,281	$ (23,023)	$ 342,552	$ 194,815	$ (11,973)
Ending Balance (shares) at Dec. 31, 2013		31,387,668