Notes to Financial Statements [Abstract] Notes to Financial Statements [Abstract] Statement [Table] Statement [Table] Legal Entity [Axis] Legal Entity [Axis] Entity [Domain] Entity [Domain] Statement [Line Items] Statement [Line Items] Derivative Financial Instruments Derivative Instruments and Hedging Activities Disclosure [Text Block] Borrowing Arrangements Debt Disclosure [Text Block] Fair Value Fair Value Disclosures [Text Block] Income Taxes Income Tax Disclosure [Text Block] Preferred Stock and Common Stock Warrant Stockholders' Equity Note Disclosure [Text Block] Accumulated Other Comprehensive Income Accumulated Other Comprehensive Income (Loss) Note [Text Block] Accumulated Other Comprehensive Income (Loss) Note [Text Block] Income Statement [Abstract] Interest income: Interest and Dividend Income, Operating [Abstract] Interest and fees on loans Interest and Fee Income, Loans and Leases Held-in-portfolio Interest on loans held for sale Interest and Fee Income, Loans and Leases Held-for-sale Taxable investments Interest Income, Securities, Taxable Tax-exempt investments Interest Income, Securities, Tax Exempt Federal funds sold Interest Income, Federal Funds Sold Interest bearing bank balances Interest Income, Deposits with Financial Institutions Total interest income Interest and Dividend Income, Operating Interest expense: Interest Expense [Abstract] Deposits Interest Expense, Deposits Federal funds purchased and repurchase agreements Interest Expense, Federal Funds Purchased and Securities Sold under Agreements to Repurchase Other borrowings Interest Expense, Other borrowings Interest expense incurred during the reporting period on other borrowings. Junior subordinated debt Interest Expense, Junior Subordinated Debentures Total interest expense Interest Expense Net interest income Interest Income (Expense), Net Provision for loan losses Provision for Loan and Lease Losses Net interest income after provision for loan losses Interest Income (Expense), after Provision for Loan Loss Noninterest income: Noninterest Income [Abstract] Deposit account income Fees and Commissions, Depositor Accounts Mortgage banking income Fees and Commissions, Mortgage Banking Agency commission income Insurance Commissions and Fees Trust and brokerage income Fees and Commissions, Fiduciary and Trust Activities Bank owned life insurance income Bank Owned Life Insurance Income Other income Noninterest Income, Other Operating Income Securities gains, net Gain (Loss) on Sale of Investments Total investment other-than-temporary impairment losses Other than Temporary Impairment Losses, Investments Portion of loss recognized in (reclassified from) other comprehensive income (before taxes) Other than Temporary Impairment Losses, Investments, Portion in Other Comprehensive Income (Loss), before Tax, Including Portion Attributable to Noncontrolling Interest Net investment impairment losses recognized Other than Temporary Impairment Losses, Investments, Portion Recognized in Earnings, Net Total noninterest income Noninterest Income Noninterest expenses: Noninterest Expense [Abstract] Salaries and employee benefits Labor and Related Expense Net occupancy expenses Occupancy, Net Equipment expenses Equipment Expense Software and processing expenses Information Technology and Data Processing Telecommunication expenses Communication Marketing and business development expenses Marketing and Advertising Expense Foreclosed property expenses Foreclosed Real Estate Expense FDIC insurance assessments Federal Deposit Insurance Corporation Premium Expense Intangible asset amortization Amortization of Intangible Assets Other expenses Other Noninterest Expense Total noninterest expenses Noninterest Expense Income before income taxes Income (Loss) from Continuing Operations before Equity Method Investments, Income Taxes, Extraordinary Items, Noncontrolling Interest Income tax expense Income Tax Expense (Benefit) Net income Net Income (Loss), Including Portion Attributable to Noncontrolling Interest Net income attributable to noncontrolling interests Net Income (Loss) Attributable to Noncontrolling Interest Net income attributable to First M&F Corporation Net Income (Loss) Attributable to Parent Dividends and accretion on preferred stock Preferred Stock Dividends and Other Adjustments Gain on exchange of preferred stock Gain on Exchange of Preferred Stock Gain on Exchange of Preferred Stock Net income applicable to common stock Net Income (Loss) Available to Common Stockholders, Basic Net income allocated to common shareholders Net Income Attributable To Common Shareholders After Earnings Allocated To Participating Share Awards And Other Items Net Income Attributable To Common Shareholders After Earnings Allocated To Participating Share Awards And Other Items. Earnings per share: Earnings Per Share [Abstract] Basic Earnings Per Share, Basic Diluted Earnings Per Share, Diluted Summary of Significant Accounting Policies Significant Accounting Policies [Text Block] Pension and Other Employee Benefits Plans Pension and Other Postretirement Benefits Disclosure [Text Block] Statement of Cash Flows [Abstract] Cash flows from operating activities: Net Cash Provided by (Used in) Operating Activities [Abstract] Net income Adjustments to reconcile net income to net cash provided by operating activities: Adjustments to Reconcile Net Income (Loss) to Cash Provided by (Used in) Operating Activities [Abstract] Share-based compensation Share-based Compensation Amortization of pension costs Amortization Of Pension And Postretirement Costs Amortization of unrecognized gains and losses and prior service costs of pension and postretirement benefit plans. Depreciation and amortization Depreciation, Depletion and Amortization, Nonproduction Net investment amortization Accretion (Amortization) of Discounts and Premiums, Investments Net change in unearned fees/deferred costs on loans Amortization of Deferred Loan Origination Fees, Net Capitalized dividends on FHLB stock Other Noncash Income Gain on securities available for sale Impairment loss on securities available for sale Gain on loans held for sale Gain (Loss) on Sale of Loans and Leases Other real estate losses Gains (Losses) on Sales of Other Real Estate Other asset sales losses Gain (Loss) on Sale of Other Assets Deferred income taxes Deferred Income Tax Expense (Benefit) Originations of loans held for sale, net of repayments Payments for Origination of Mortgage Loans Held-for-sale Sales proceeds of loans held for sale Proceeds from Sale of Mortgage Loans Held-for-sale (Increase) decrease in: Increase (Decrease) in Operating Assets [Abstract] Accrued interest receivable Increase (Decrease) in Accrued Interest Receivable, Net Cash surrender value of bank owned life insurance Other assets Increase (Decrease) in Other Operating Assets Increase (decrease) in: Increase (Decrease) in Operating Liabilities [Abstract] Accrued interest payable Increase (Decrease) in Interest Payable, Net Other liabilities Increase (Decrease) in Other Operating Liabilities Net cash provided by operating activities Net Cash Provided by (Used in) Operating Activities Cash flows from investing activities: Net Cash Provided by (Used in) Investing Activities [Abstract] Purchases of securities available for sale Payments to Acquire Available-for-sale Securities Sales of securities available for sale Proceeds from Sale of Available-for-sale Securities Maturities of securities available for sale Proceeds from Maturities, Prepayments and Calls of Available-for-sale Securities Purchases of loans held for investment Payments to Acquire Loans Held-for-investment Net (increase) decrease in other loans held for investment Payments for (Proceeds from) Loans and Leases Net (increase) decrease in: Payments for (Proceeds from) Investments [Abstract] Interest bearing bank balances Proceeds from (Payments for) in Interest-bearing Deposits in Banks Federal funds sold Increase (Decrease) in Federal Funds Sold Bank premises and equipment Payments to Acquire Property, Plant, and Equipment Net purchases of bank owned life insurance Payments for (Proceeds from) Life Insurance Policies Proceeds from sales of other real estate and other repossessed assets Proceeds from Sale of Foreclosed Assets Net cash provided by investing activities Net Cash Provided by (Used in) Investing Activities Cash flows from financing activities: Net Cash Provided by (Used in) Financing Activities [Abstract] Net increase (decrease) in deposits Increase (Decrease) in Deposits Net increase (decrease) in short-term borrowings Increase (Decrease) in Federal Funds Purchased and Securities Sold under Agreements to Repurchase, Net Proceeds from other borrowings Proceeds from Other Debt Repayments of other borrowings Repayments of Other Debt Earnings distributions to noncontrolling interests Proceeds from (Payments to) Noncontrolling Interests Common stock issued Proceeds from Issuance of Common Stock Common dividends paid Payments of Dividends, Common Stock Preferred dividends paid Payments of Dividends, Preferred Stock and Preference Stock Net cash used in financing activities Net Cash Provided by (Used in) Financing Activities Net decrease in cash and due from banks Cash and Cash Equivalents, Period Increase (Decrease) Cash and due from banks at January 1 Cash and Due from Banks Cash and due from banks at March 31 Supplemental disclosures: Supplemental Cash Flow Information [Abstract] Total interest paid Interest Paid Total income taxes paid Income Taxes Paid Income tax refunds received Proceeds from Income Tax Refunds Transfers of loans from held for sale to held for investment Transfer of Loans Held-for-sale to Portfolio Loans Transfers of loans to foreclosed property Transfer From Loans To Foreclosed Assets Transfer From Loans To Foreclosed Assets Transfers of buildings to foreclosed property Transfer Of Fixed Assets To Other Real Estate Owned Transfer Of Fixed Assets To Other Real Estate Owned Gain on exchange of Class B preferred stock U. S. Treasury preferred dividend accrued but unpaid Preferred Dividends Accrued Not Yet Paid Preferred Dividends Accrued Not Yet Paid Accretion on U. S. Treasury preferred stock Accretion on U. S. Treasury preferred stock Accretion on U.S. Treasury preferred stock Statement of Income and Comprehensive Income [Abstract] Other comprehensive income (loss): Other Comprehensive Income (Loss), Net of Tax [Abstract] Unrealized gains (losses) on securities: Other Comprehensive Income (Loss), Available-for-sale Securities Adjustment, Net of Tax [Abstract] Unrealized gains on securities available for sale arising during the period, net of tax of $156 and $188 for the three months ended March 31 Other Comprehensive Income (Loss), Unrealized Holding Gain (Loss) on Securities Arising During Period, Net of Tax Unrealized gains (losses) on other-than-temporarily impaired securities available for sale arising during the period, net of tax of $20 and $25 for the three months ended March 31 Other Comprehensive Income Net Unrealized Gains And Losses On Other Than Temporarily Impaired Securities Net Of Tax Appreciation or loss in value (before reclassification adjustment) of the total of unsold securities during the period being reported on, net of tax. Reclassification adjustments include: (1) the unrealized holding gain or loss, net of tax, at the date of the transfer for a debt security from the held-to-maturity category transferred into the available-for-sale category. Also includes the unrealized gain or loss at the date of transfer for a debt security from the available-for-sale category transferred into the held-to-maturity category; (2) the unrealized gains or losses realized upon the sale of securities, after tax; and (3) the unrealized gains or losses realized upon the write-down of securities, after tax. Reclassification adjustment for gains on securities available for sale included in net income, net of tax of $220 and $503 for the three months ended March 31 Other Comprehensive Income (Loss), Reclassification Adjustment for Sale of Securities Included in Net Income, Net of Tax Reclassification adjustment for credit related other-than-temporary impairment losses on securities available for sale included in net income, net of tax of $0 and $110 for the three months ended March 31 Other Comprehensive Income (Loss), Reclassification Adjustment for Write-down of Securities Included in Net Income, Net of Tax Unrealized losses net of settlements on cash flow hedge arising during the period, net of tax of $40 and $64 for the three months ended March 31 Other Comprehensive Income (Loss), Derivatives Qualifying as Hedges, Net of Tax Defined benefit pension plans: Other Comprehensive Income (Loss), Pension and Other Postretirement Benefit Plans, Adjustment, Net of Tax [Abstract] Amortization of prior service cost, net of tax of $0 and $2 for the three months ended March 31 Other Comprehensive Income (Loss), Amortization, Pension and Other Postretirement Benefit Plans, Net Prior Service Cost Recognized in Net Periodic Pension Cost, Net of Tax Amortization of actuarial loss, net of tax of $199 and $91 for the three months ended March 31 Other Comprehensive Income (Loss), Reclassification, Pension and Other Postretirement Benefit Plans, Net (Gain) Loss Recognized in Net Periodic Benefit Cost, Net of Tax Other comprehensive income (loss) Other Comprehensive Income (Loss), Net of Tax Total comprehensive income Comprehensive Income (Loss), Net of Tax, Including Portion Attributable to Noncontrolling Interest Comprehensive income (loss) attributable to noncontrolling interests Comprehensive Income (Loss), Net of Tax, Attributable to Noncontrolling Interest Comprehensive income of First M&F Corp Comprehensive Income (Loss), Net of Tax, Attributable to Parent Statement of Stockholders' Equity [Abstract] Statement, Equity Components [Axis] Statement, Equity Components [Axis] Equity Component [Domain] Equity Component [Domain] Preferred Stock Preferred Stock [Member] Common Stock Common Stock [Member] Additional Paid-in Capital Additional Paid-in Capital [Member] Nonvested Restricted Stock Awards Deferred Compensation Restricted Shares Member Deferred Compensation Restricted Shares - Ending Balance Retained Earnings Retained Earnings [Member] Accumulated Other Comprehensive Income (Loss) Accumulated Other Comprehensive Income (Loss) [Member] Increase (Decrease) in Stockholders' Equity [Roll Forward] Beginning Balance Stockholders' Equity, Including Portion Attributable to Noncontrolling Interest Cash dividends ($.01 per share) Dividends, Common Stock, Cash Shares granted to directors Stock Issued During Period, Value, Share-based Compensation, Gross Dividends and accretion on preferred stock Dividends, Accretion Preferred Stock Accretion of preferred stock and dividends declared. Share-based compensation expense recognized Adjustments to Additional Paid in Capital, Share-based Compensation, Requisite Service Period Recognition Net change Ending Balance Earnings Per Share Earnings Per Share [Text Block] Statement of Financial Position [Abstract] Assets Assets [Abstract] Cash and due from banks Cash and Cash Equivalents, at Carrying Value Cash and Cash Equivalents, at Carrying Value Interest bearing bank balances Interest-bearing Deposits in Banks and Other Financial Institutions Federal funds sold Federal Funds Sold Securities available for sale, amortized cost of $361,199 and $315,890 Available-for-sale Securities Loans held for sale Loans Receivable Held-for-sale, Net Loans, net of unearned income Loans and Leases Receivable, Net of Deferred Income Allowance for loan losses Loans and Leases Receivable, Allowance Net loans Loans and Leases Receivable, Net Reported Amount Bank premises and equipment Property, Plant and Equipment, Net Accrued interest receivable Interest Receivable Other real estate Other Real Estate and Foreclosed Assets Other intangible assets Intangible Assets, Net (Excluding Goodwill) Bank owned life insurance Bank Owned Life Insurance Other assets Other Assets Total assets Assets Liabilities and Equity Liabilities and Equity [Abstract] Liabilities: Liabilities [Abstract] Noninterest-bearing deposits Noninterest-bearing Deposit Liabilities Interest-bearing deposits Interest-bearing Deposit Liabilities Total deposits Deposits Federal funds purchased and repurchase agreements Federal Funds Purchased and Securities Sold under Agreements to Repurchase Other borrowings Other Borrowings Junior subordinated debt Junior Subordinated Notes Accrued interest payable Interest Payable Other Liabilities Other Liabilities Total liabilities Liabilities Commitments and contingencies Commitments and Contingencies Stockholders' Equity: Stockholders' Equity, Including Portion Attributable to Noncontrolling Interest [Abstract] Preferred Stock; 2,000,000 shares authorized; 30,000 shares issued and outstanding Preferred Stock, Value, Issued Common Stock of $5.00 par value; 50,000,000 shares authorized: 9,162,721 and 9,154,936 shares issued and outstanding Common Stock, Value, Issued Additional paid-in capital Additional Paid in Capital Nonvested restricted stock awards Restricted stock units and employee stock options Restricted stock units and employee stock options Retained earnings Retained Earnings (Accumulated Deficit) Accumulated other comprehensive income (loss) Accumulated Other Comprehensive Income (Loss), Net of Tax Total equity Total liabilities and equity Liabilities and Equity Other Intangible Assets Intangible Assets Disclosure [Text Block] Loans and Allowance for Loan Losses Loans, Notes, Trade and Other Receivables Disclosure [Text Block] Variable Interest Entities Consolidation Of Variable Interest Entities Disclosure [Text Block] Consolidation Of Variable Interest Entities Disclosure[Text Block] Investment Securities Investments In Debt And Marketable Equity Securities And Certain Trading Assets [Text Block] Investments In Debt And Marketable Equity Securities And Certain Trading Assets [Text Block] Regulatory Matters Regulatory Capital Requirements under Banking Regulations [Text Block] Share-based Compensation Share-based Compensation Arrangements by Share-based Payment Award [Text Block] Share-based Compensation Arrangements by Share-based Payment Award [Text Block] Document Document And Entity Information [Abstract] Document - Document and Entity Information [Abstract] Document Type Document Type Amendment Flag Amendment Flag Document Period End Date Document Period End Date Document Fiscal Year Focus Document Fiscal Year Focus Document Fiscal Period Focus Document Fiscal Period Focus Trading Symbol Trading Symbol Entity Registrant Name Entity Registrant Name Entity Central Index Key Entity Central Index Key Current Fiscal Year End Date Current Fiscal Year End Date Entity Filer Category Entity Filer Category Entity Common Stock, Shares Outstanding Entity Common Stock, Shares Outstanding Entity Well-known Seasoned Issuer Entity Well-known Seasoned Issuer Entity Voluntary Filers Entity Voluntary Filers Entity Current Reporting Status Entity Current Reporting Status Unrealized gains on securities available for sale arising during the period, tax Other Comprehensive Income (Loss), Unrealized Holding Gain (Loss) on Securities Arising During Period, Tax Unrealized gains (losses) on other-than-temporarily impaired securities available for sale arising during the period, tax Other Comprehensive Income Net Unrealized Gains And Losses On Other Than Temporarily Impaired Securities Tax Other Comprehensive Income, Net Unrealized Gains and Losses on Other Than Temporarily Impaired Securities, Tax Reclassification adjustment for gain on securities available for sale included in net income, tax Other Comprehensive Income (Loss), Reclassification Adjustment for Sale of Securities Included in Net Income, Tax Reclassification adjustment for credit related other-than-temporary impairment losses on securities available for sale included in net income, tax Other Comprehensive Income (Loss), Reclassification Adjustment for Write-down of Securities Included in Net Income, Tax Unrealized losses net of settlements on cash flow hedge arising during the period, tax Other Comprehensive Income (Loss), Derivatives Qualifying as Hedges, Tax Effect Amortization of prior service cost, tax Other Comprehensive Income (Loss), Amortization, Pension and Other Postretirement Benefit Plans, Net Prior Service Cost Recognized in Net Periodic Pension Cost, Tax Effect Amortization of actuarial loss, tax Other Comprehensive Income (Loss), Pension and Other Postretirement Benefit Plans, Net Unamortized Gain (Loss) Arising During Period, Tax Securities available for sale, amortized cost Available-for-sale Securities, Amortized Cost Basis Preferred stock, shares authorized Preferred Stock, Shares Authorized Preferred stock, shares issued Preferred Stock, Shares Issued Preferred stock, shares outstanding Preferred Stock, Shares Outstanding Common stock, par value Common Stock, Par or Stated Value Per Share Common stock, shares authorized Common Stock, Shares Authorized Common stock, shares issued Common Stock, Shares, Issued Common stock, shares outstanding Common Stock, Shares, Outstanding Cash dividends, per share Common Stock, Dividends, Per Share, Declared Shares granted to directors, shares Stock Issued During Period, Shares, Share-based Compensation, Gross