Borrowing Arrangements (Details) (USD $)			3 Months Ended					6 Months Ended			6 Months Ended				1 Months Ended	3 Months Ended	6 Months Ended
	Jun. 30, 2013	Dec. 31, 2012	Jun. 30, 2013 Interest rate swap	Jun. 30, 2013 Interest rate swap Designated as Cash Flow Hedging Instrument	Nov. 30, 2010 Interest rate swap Designated as Cash Flow Hedging Instrument	Jun. 30, 2013 Federal Home Loan Bank of Dallas	Jun. 30, 2013 Federal Reserve Discount Window	Jun. 30, 2013 Revolving Line of Credit Maturing July 2013	Dec. 31, 2012 Revolving Line of Credit Maturing July 2013	Jun. 30, 2012 Revolving Line of Credit Maturing July 2013 payments	Jun. 30, 2013 Junior Subordinated Debt Maturing March 2036	Dec. 31, 2012 Junior Subordinated Debt Maturing March 2036	Jun. 30, 2012 Junior Subordinated Debt Maturing March 2036	Jun. 30, 2013 Junior Subordinated Debt Maturing March 2036 Maximum payment	Feb. 28, 2006 Fixed/Floating Junior Subordinated Deferrable Interest Debentures Maturing March 2036 First M&F Statutory Trust I	Jun. 30, 2013 Fixed/Floating Junior Subordinated Deferrable Interest Debentures Maturing March 2036 First M&F Statutory Trust I	Jun. 30, 2013 LIBOR Interest rate swap Designated as Cash Flow Hedging Instrument
Debt Instrument [Line Items]
Company’s line of credit in the amount of $5,000,000, maturing in July 2013; secured by approximately 51% of the Bank’s common stock; interest payable quarterly at the prime rate with a floor of 3.50%								$ 2,792,000	$ 2,792,000
Bank’s advances from Federal Home Loan Banks	0	33,215,000
Other borrowings	2,792,000	36,007,000
Company’s junior subordinated debentures, interest payable quarterly at 90-day LIBOR plus 1.33% through March 2036; currently redeemable	30,928,000	30,928,000									30,928,000	30,928,000
Line of credit maximum borrowing capacity								5,000,000
Line of credit facility, frequency of payments								quarterly
Percent of common stock securing line of credit (percent)								51.00%
Line of credit interest rate floor (percent)								3.50%
Floating interest rate over LIBOR (percent)				1.33%							1.33%
Debt, frequency of periodic payment											quarterly					quarterly
Number of required principal payments (payment)										3
Required payment for Q2 2012										125,000
Required payment for Q3 2012													125,000
Required payment for Q4 2012													125,000
Available amount of line of credit						60,634,000	8,600,000
Fixed/floating rate junior subordinated deferrable interest debentures															30,928,000
Cash received															30,000,000
Common securities received in transaction															928,000
Number of consecutive quarterly payments of interest that may be deferred (payments)														20
Interest rate swap, notional value					$ 30,000,000
Interest rate swap, stated rate (percent)				3.795%
Description of variable rate basis			three month LIBOR														90-day LIBOR