Derivative Instruments (Details Textual) (USD $)	6 Months Ended		6 Months Ended						3 Months Ended		6 Months Ended							0 Months Ended		0 Months Ended
	Jun. 30, 2014	Jun. 05, 2014 Derivative_Instrument	Jun. 30, 2014 August 2013 Derivative_Instrument	Jun. 30, 2014 August 2012 Derivative_Instrument	Jun. 30, 2014 Interest rate contracts with corporate customers	Jun. 30, 2014 Offsetting interest rate contracts with other financial institutions	Jun. 30, 2014 Cash Flow Hedging	Apr. 30, 2014 Cash Flow Hedging Derivative_Instrument	Jun. 30, 2014 Interest rate swaps Designated as hedging instruments:	Jun. 30, 2013 Interest rate swaps Designated as hedging instruments:	Jun. 30, 2014 Interest rate swaps Designated as hedging instruments:	Jun. 30, 2013 Interest rate swaps Designated as hedging instruments:	Jun. 30, 2014 Commitments to fund fixed-rate residential mortgage loans	Dec. 31, 2013 Commitments to fund fixed-rate residential mortgage loans	Jun. 30, 2014 Commitments to sell residential mortgage loans	Dec. 31, 2013 Commitments to sell residential mortgage loans	Jun. 30, 2014 First M&F Cash Flow Hedging	Jun. 05, 2014 Floating Rate Liability at the Bank Level, Derivative One Interest rate swaps	Jun. 05, 2014 Floating Rate Liability at the Bank Level, Derivative One Interest rate swaps	Jun. 05, 2014 Floating Rate Liability at the Bank Level, Derivative Two Interest rate swaps	Jun. 05, 2014 Floating Rate Liability at the Bank Level, Derivative Two Interest rate swaps
Derivative Instruments (Textual) [Abstract]
Junior subordinated debentures	$ 75,000,000				$ 73,628,000	$ 73,628,000	$ 32,000,000						$ 88,293,000	$ 54,807,000	$ 80,000,000	$ 50,000,000	$ 30,000,000		$ 15,000,000		$ 15,000,000
Number of instruments held (instruments)		2						2
Term of contract																		4 years		5 years
Fixed interest rate (percent)																			3.593%		3.738%
Variable interest rate of derivatives, description	the three-month LIBOR plus a pre-determined spread
Number of derivative instruments terminated (derivative instruments)			2	2
Derivative instruments deferred gain			1,679,000	1,679,000
Gains (losses) on derivative financial instruments									$ 0	$ 80,000	$ 0	$ 165,000