Derivative Instruments (Details Textual) (USD $)	2 Months Ended			1 Months Ended				1 Months Ended	3 Months Ended		9 Months Ended							0 Months Ended		0 Months Ended
	Apr. 30, 2012	Sep. 30, 2014	Jun. 05, 2014 Derivative_Instrument	May 31, 2010 August 2012	Sep. 30, 2014 Interest rate contracts with corporate customers	Sep. 30, 2014 Offsetting interest rate contracts with other financial institutions	Apr. 30, 2012 Cash Flow Hedging Derivative_Instrument	May 31, 2010 Interest rate swaps Designated as hedging instruments: Derivative_Instrument	Sep. 30, 2014 Interest rate swaps Designated as hedging instruments:	Sep. 30, 2013 Interest rate swaps Designated as hedging instruments:	Sep. 30, 2014 Interest rate swaps Designated as hedging instruments:	Sep. 30, 2013 Interest rate swaps Designated as hedging instruments:	Sep. 30, 2014 Commitments to fund fixed-rate residential mortgage loans	Dec. 31, 2013 Commitments to fund fixed-rate residential mortgage loans	Sep. 30, 2014 Commitments to sell residential mortgage loans	Dec. 31, 2013 Commitments to sell residential mortgage loans	Sep. 30, 2014 First M&F Cash Flow Hedging	Jun. 05, 2014 Floating Rate Liability at the Bank Level, Derivative One Interest rate swaps	Jun. 05, 2014 Floating Rate Liability at the Bank Level, Derivative One Interest rate swaps	Jun. 05, 2014 Floating Rate Liability at the Bank Level, Derivative Two Interest rate swaps	Jun. 05, 2014 Floating Rate Liability at the Bank Level, Derivative Two Interest rate swaps
Derivative Instruments (Textual) [Abstract]
Junior subordinated debentures		$ 75,000,000			$ 75,462,000	$ 75,462,000	$ 32,000,000						$ 79,172,000	$ 54,807,000	$ 75,000,000	$ 50,000,000	$ 30,000,000				$ 15,000,000
Number of instruments held			2				2
Term of contract																		4 years		5 years
Fixed interest rate (percent)																			3.593%		3.738%
Variable interest rate of derivatives, description	the three-month LIBOR plus a pre-determined spread
Number of derivative instruments terminated (derivative instruments)								2
Derivative instruments deferred gain				1,679,000
Gains (losses) on derivative financial instruments									$ 0	$ 37,000	$ 0	$ 203,000