Document and Entity Information Document Information [Table] Document Information [Line Items] Document Type Document Period End Date Entity Registrant Name Entity Current Reporting Status Entity Interactive Data Current Entity Filer Category Entity Small Business Entity Emerging Growth Company Entity Shell Company Entity Common Stock, Shares Outstanding Current Fiscal Year End Date Document Fiscal Year Focus Document Fiscal Period Focus Entity Central Index Key Amendment Flag CONSOLIDATED BALANCE SHEETS Statement [Table] Class of Stock [Axis] Class Of Stock [Domain] Class of Stock [Domain] Series A Preferred Stock [Member] Series A-1 junior participating preferred stock Series B Preferred Stock [Member] Series B 9.375% redeemable preferred stock Series C Preferred Stock [Member] Series C 9.125% redeemable preferred stock Statement [Line Items] Statement Assets [Abstract] ASSETS Cash and Cash Equivalents, at Carrying Value Cash and cash equivalents Unrestricted cash Restricted cash and cash equivalents, current Restricted cash Loans Receivable Held-for-sale, Net, Not Part of Disposal Group Mortgage loans held-for-sale Total mortgage loans held-for-sale Servicing Asset at Fair Value, Amount Fair value of MSRs at end of period Balance at beginning of year Mortgage servicing rights This element represents the total trust assets including investment securities available-for-sale, securitized mortgage collateral, derivative assets, and real estate owned. Securitized Mortgage Trust Assets Securitized mortgage trust assets Total securitized mortgage trust assets Other Assets. Other assets Assets Total assets Liabilities [Abstract] LIABILITIES Warehouse Agreement Borrowings Warehouse borrowings Balance Outstanding Mortgage Servicing Right Financing Facility Mortgage Servicing Right Financing Facility MSR financings Convertible Notes Payable Convertible notes, net Other Long-term Debt Long-term debt This element represents the trust liabilities including securitized mortgage borrowings and derivative liabilities. Securitized Mortgage Trust Liabilities Securitized mortgage trust liabilities Other Liabilities Other liabilities Liabilities Total liabilities Commitments and Contingencies. Commitments and contingencies (See Note 11) Stockholders' Equity, Including Portion Attributable to Noncontrolling Interest [Abstract] STOCKHOLDERS’ EQUITY Preferred Stock, Value, Issued Preferred stock Common Stock, Value, Issued Common stock, $0.01 par value; 200,000,000 shares authorized; 21,264,926 and 21,255,426 shares issued and outstanding as of March 31, 2020 and December 31, 2019, respectively Additional Paid in Capital Additional paid-in capital Accumulated Other Comprehensive Income (Loss), Net of Tax Accumulated other comprehensive earnings, net of tax Retained Earnings (Accumulated Deficit) [Abstract] Net accumulated deficit: Cumulative Dividends Declared. Cumulative dividends declared Retained Earnings, Unappropriated Retained deficit Retained earnings Net accumulated deficit Stockholders' Equity Attributable to Parent Balance Balance Total stockholders’ equity Liabilities and Equity Total liabilities and stockholders’ equity Preferred Stock, Par or Stated Value Per Share Preferred stock, par value (in dollars per share) Preferred Stock, Dividend Rate, Percentage Preferred stock, dividend rate (as a percent) Preferred Stock, Liquidation Preference, Value Preferred stock, liquidation value (in dollars) Outstanding liquidation preference Preferred Stock, Shares Authorized Preferred stock, shares authorized Preferred Stock, Shares Issued Preferred stock, shares issued Preferred Stock, Shares Outstanding Preferred stock, shares outstanding Common Stock, Par or Stated Value Per Share Common stock, par value (in dollars per share) Common Stock, Shares Authorized Common stock, shares authorized Common Stock, Shares, Issued Common stock, shares issued Common Stock, Shares, Outstanding Common stock, shares outstanding CONSOLIDATED STATEMENTS OF OPERATIONS AND COMPREHENSIVE LOSS Revenues [Abstract] Revenues: Gain (Loss) on Sales of Loans, Net (Loss) gain on sale of loans, net The total amount of contractually specified servicing fees, late fees, and ancillary fees net of servicing costs that are earned for each period for which results of operations are presented. Servicing Income, Net Servicing fees, net Servicing fees, net Revenue from Contract with Customer, Including Assessed Tax Real estate services fees, net Amount of gain (loss) on mortgage servicing rights, net of change in fair value during the period. Mortgage Servicing Rights Gain Loss Net Loss on mortgage servicing rights, net Loss on mortgage servicing rights, net Represents other forms of revenue earned or loss, excluding interest, which is not otherwise specified in the taxonomy. Non Interest Income Other Operating Income Loss Other Other revenue Revenues Total revenues, net Operating Expenses [Abstract] Expenses: Labor and Related Expense Personnel expense General and Administrative Expense General, administrative and other Marketing Expense Business promotion Operating Expenses Total expenses Operating Income (Loss) Operating loss Nonoperating Income (Expense) [Abstract] Other income (expense): Interest and Dividend Income, Operating Interest income Interest Expense, amount Interest expense This element represents change in fair value of long-term debt during the reporting period. Increase (Decrease) in Fair Value of Long Term Debt Change in fair value of long-term debt Change in fair value of long-term debt This element represents change in fair value of trust assets including gain or loss on real estate owned due to increases or decreases in the fair value of investment securities-for-sale, securitized mortgage collateral and securitized mortgage borrowings during the reporting period. Trust Assets, Net Change in Fair Value Including Real Estate Owned, Gain (Loss) Change in fair value of net trust assets, including trust REO losses Change in fair value of net trust assets, including trust REO gains Nonoperating Income (Expense) Total other income (expense), net Income (Loss) from Continuing Operations before Equity Method Investments, Income Taxes, Extraordinary Items, Noncontrolling Interest Loss before income taxes Income Tax Expense (Benefit) Income tax expense Net Income (Loss) Attributable to Parent Net loss Net loss Other comprehensive (loss) earnings: Other comprehensive loss: Amount, after tax, before reclassification adjustment, of unrealized gain (loss) from increase (decrease) in mortgage-backed securities measured under fair value option. Other Comprehensive Income (Loss), Mortgage Backed Securities, Fair Value Option, Unrealized Gain (Loss) Arising During Period, after Tax Change in fair value of mortgage-backed securities Amount, after tax, before reclassification adjustment, of unrealized gain (loss) from increase (decrease) in instrument-specific credit risk of long-term debt measured under fair value option. Other Comprehensive Income (Loss), Credit Risk of Long-term Debt, Fair Value Option, Unrealized Gain (Loss) Arising During Period After Tax Change in fair value of instrument specific credit risk of long-term debt Other Comprehensive Income (Loss), Net of Tax Total comprehensive loss Reconciliation of Loss Per Share Net loss per common share: Earnings Per Share, Basic Basic (in dollars per share) Earnings Per Share, Diluted Diluted (in dollars per share) CONSOLIDATED STATEMENTS OF CHANGES IN STOCKHOLDERS’ EQUITY Equity Components [Axis] Equity Component [Domain] Equity Component [Domain] Parent [Member] Total IMH Stockholders' Equity Preferred Stock [Member] Preferred Stock Common Stock [Member] Common Stock Additional Paid In Capital [Member] Additional Paid-In Capital The amount of cumulative dividends declared. Cumulative Dividends Declared [Member] Cumulative Dividends Declared Retained Earnings [Member] Retained Deficit Increase (Decrease) in Stockholders' Equity [Roll Forward] Increase (Decrease) in Stockholders' Equity Shares, Outstanding Balance (in shares) Balance (in shares) Stock Issued During Period, Value, Stock Options Exercised Proceeds from exercise of stock options Share-based Compensation Arrangement by Share-based Payment Award, Options, Exercises in Period Options exercised (in shares) Proceeds from exercise of stock options (in shares) Adjustments to Additional Paid in Capital, Share-based Compensation, Requisite Service Period Recognition Stock based compensation Other Comprehensive Income (Loss), Financial Liability, Fair Value Option, Unrealized Gain (Loss) Arising During Period, after Tax Other comprehensive loss The adjustment to retained earnings resulting from the consolidation of corporate-owned life insurance trusts. Consolidation of Corporate-owned life Insurance Consolidation of corporate-owned life insurance trusts CONSOLIDATED STATEMENTS OF CASH FLOWS Net Cash Provided by (Used in) Operating Activities [Abstract] CASH FLOWS FROM OPERATING ACTIVITIES: Net Income (Loss), Including Portion Attributable to Noncontrolling Interest Net loss Amount of gain (loss) on sale or disposal of mortgage servicing rights (MSRs). Gain (Loss) on Sale of Mortgage Servicing Rights Gain on sale of mortgage servicing rights Gain (loss) on sale of mortgage servicing rights Mortgage Servicing Rights (MSR) Impairment (Recovery) Change in fair value of mortgage servicing rights Change in fair value of mortgage servicing rights Gain (Loss) on Sale of Mortgage Loans Gain on sale of mortgage loans (Loss) gain on sale of loans, net The increase (decrease) during the reporting period in the fair value of mortgage loans or securitized loans that are held with the intention to sell in the near future. Increase (Decrease) in Fair Value of Mortgage Loans Held-for-sale Change in fair value of mortgage loans held-for-sale Represents the change in fair value of derivatives lending, net during the reporting period. Increase (Decrease) in Fair Value of Derivatives Lending Net Change in fair value of derivatives lending, net Amount of the current period expense charged against operations with respect to provision or recovery of previously charged amount. Provision for Repurchases Provision for repurchases Provision for repurchases Payments for Origination of Mortgage Loans Held-for-sale Origination of mortgage loans held-for-sale Proceeds from Sale of Mortgage Loans Held-for-sale Sale and principal reduction on mortgage loans held-for-sale This element represents gains (losses) from real estate owned at the time of sale or losses from further write-downs. Gain Loss from Real Estate Owned Gains from trust REO Gains from REO This element represents change in fair value of trust assets excluding real estate owned due to decreases in the fair value of investment securities-for-sale and of securitized mortgage collateral during the reporting period. Increase (Decrease) in Fair Value of Net Trust Assets Excluding Real Estate Owned Change in fair value of net trust assets, excluding trust REO This element represents the accretion to recognize interest income and interest expense using effective yields based on estimated fair values for trust assets and trust liabilities. Accretion of Interest Income and Expense Accretion of interest income and expense The aggregate expense charged against earnings to allocate the cost of intangible assets (nonphysical assets not used in production) and other assets in a systematic and rational manner to the periods expected to benefit from such assets. As a noncash expense, this element is added back to net income when calculating cash provided by or used in operations using the indirect method. Amortization of Intangible and Other Assets Amortization of intangible and other assets Represents the write-off of amounts previously capitalized as debt issuance cost in an extinguishment of debt and noncash expense included in interest expense to amortize debt discount and premium associated with the related debt instruments. Amortization of Debt Issuance Cost and Debt Discount Premium Amortization of debt issuance costs and discount on note payable Share-based Compensation Stock-based compensation Increase (Decrease) in Other Operating Assets Net change in other assets Increase (Decrease) in Other Operating Liabilities Net change in other liabilities Net Cash Provided by (Used in) Operating Activities Net cash provided by (used in) operating activities Net Cash Provided by (Used in) Investing Activities [Abstract] CASH FLOWS FROM INVESTING ACTIVITIES: This element represents net change during the reporting period in securitized mortgage collateral. Net Change in Securitized Mortgage Collateral Net change in securitized mortgage collateral Proceeds from Sale of Mortgage Servicing Rights (MSR) Proceeds from the sale of mortgage servicing rights Payments for (Proceeds from) Productive Assets Purchase of premises and equipment Payments to Acquire Mortgage-backed Securities (MBS), Available-for-sale Purchase of mortgage-backed securities Proceeds from Sale of Other Real Estate Proceeds from the sale of trust REO Net Cash Provided by (Used in) Investing Activities Net cash provided by investing activities Net Cash Provided by (Used in) Financing Activities [Abstract] CASH FLOWS FROM FINANCING ACTIVITIES: The cash inflow from borrowings under mortgage servicing rights financing. Borrowings Under MSR Financing Borrowings under MSR financing The cash outflow for a borrowing of warehouse having initial term of repayment within one year or the normal operating cycle, if longer. Repayment Of Warehouse Borrowings Repayment of warehouse borrowings The cash inflow from a borrowing of warehouse having initial term of repayment within one year or the normal operating cycle, if longer. Borrowings Under Warehouse Agreement Borrowings under warehouse agreements Proceeds from (Repayments of) Secured Debt Repayment of securitized mortgage borrowings Finance Lease, Principal Payments Principal payments on capital lease Payments Related to Tax Withholding for Share-based Compensation Tax payments on stock based compensation awards Proceeds from Stock Options Exercised Proceeds from exercise of stock options Net Cash Provided by (Used in) Financing Activities Net cash used in financing activities Cash, Cash Equivalents, Restricted Cash and Restricted Cash Equivalents, Period Increase (Decrease), Including Exchange Rate Effect Net change in cash, cash equivalents and restricted cash Cash, Cash Equivalents, Restricted Cash and Restricted Cash Equivalents Cash, cash equivalents and restricted cash at end of year Cash, cash equivalents and restricted cash at beginning of year Supplemental Cash Flow Information [Abstract] NON-CASH TRANSACTIONS: Real Estate Owned, Transfer to Real Estate Owned Transfer of securitized mortgage collateral to trust REO This element represents mortgage servicing rights retained from loan sales and issuance of mortgage backed securities during the reporting period in a noncash transaction. Mortgage Servicing Rights Retained from Loan Sales and Issuance of Mortgage Backed Securities Mortgage servicing rights retained from issuance of mortgage backed securities and loan sales Recognition of cash surrender value of corporate-owned life insurance in noncash investing or financing activities. Recognition of Corporate-owned Life Insurance Cash Surrender Value Recognition of corporate-owned life insurance cash surrender value (included in Other assets) Recognition of corporate-owned life insurance trusts in noncash investing and financing activities. Recognition of Corporate-owned Life Insurance Trusts Recognition of corporate owned life insurance trusts (included in Other liabilities) Amount of lessee's right to use underlying asset under operating lease. Initial Recognition Of Operating Lease Right Of Use Assets Recognition of operating lease right of use assets (net of $3.8 million of deferred rent) Present value of lessee's discounted obligation for lease payments from operating lease. Initial Recognition Of Operating Lease Liabilities Recognition of operating lease liabilities Deferred Rent Credit, Noncurrent Deferred rent liability Summary of Business and Financial Statement Presentation Organization, Consolidation, Basis of Presentation, Business Description and Accounting Policies [Text Block] Summary of Business and Financial Statement Presentation including Significant Accounting Policies Mortgage Loans Held-for-Sale The entire disclosure for unpaid principal balance of mortgage loans held-for-sale during the accounting period. Mortgage Loans Held For Sale Disclosure [Text Block] Mortgage Loans Held-for-Sale Mortgage Servicing Rights Represents the entire disclosure of mortgage servicing rights (recognized as an asset) during the reporting period. Mortgage Servicing Rights Disclosure [Text Block] Mortgage Servicing Rights Leases The entire disclosure of information about leases. Lease Disclosure [Text Block] Leases Debt Schedule of Long-term Debt Instruments [Table] Debt Instrument [Line Items] Long-term Debt Convertible Notes Debt Disclosure [Text Block] Debt Securitized Mortgage Trusts Disclosure for information pertaining to securitized mortgage trusts. Securitized Mortgage Trusts Disclosure [Text Block] Securitized Mortgage Trusts Fair Value of Financial Instruments Derivatives and Fair Value [Text Block] Fair Value of Financial Instruments Income Taxes Income Tax Disclosure [Text Block] Income Taxes Earnings Per Share [Text Block] Reconciliation of Loss Per Share Segment Reporting Segment Reporting Disclosure [Text Block] Segment Reporting Commitments and Contingencies Commitments and Contingencies Disclosure [Text Block] Commitments and Contingencies Equity and Share Based Payments Disclosure of Compensation Related Costs, Share-based Payments [Text Block] Equity and Share Based Payments Subsequent Events Subsequent Events [Text Block] Subsequent Events Basis of Accounting, Policy [Policy Text Block] Financial Statement Presentation Disclosure of accounting policy related to unusual risks and uncertainties. Unusual Risks and Uncertainties [Policy Text Block] Risks and Uncertainties New Accounting Pronouncements, Policy [Policy Text Block] Recent Accounting Pronouncements Tabular disclosure of the unpaid principal balance of mortgage loans held-for-sale by type. Schedule of Mortgage Loans Held For Sale [Table Text Block] Summary of the unpaid principal balance (UPB ) of mortgage loans held-for-sale by type Tabular disclosure of gain on mortgage loans held for sale. Schedule of Gain on Mortgage Loans Held For Sale [Table Text Block] Schedule of gain (loss) on sale of loans, net Schedule of Servicing Assets at Fair Value [Table] Servicing Assets at Fair Value [Line Items] Mortgage Servicing Rights Securitized Mortgage Collateral Schedule of Servicing Assets at Fair Value [Table Text Block] Schedule of changes in the fair value of MSRs Tabular disclosure of servicing assets by portfolio. Schedule of Servicing Assets Portfolio [Table Text Block] Schedule of the outstanding loans serviced by entity Schedule of Sensitivity Analysis of Fair Value, Transferor's Interests in Transferred Financial Assets [Table Text Block] Schedule of hypothetical changes in the fair values of MSRs Tabular disclosure of gain (loss), net on mortgage servicing rights. Schedule Of Mortgage Servicing Rights Gain Loss Net Table Text Block Schedule of gain (loss) on mortgage servicing rights Represents the schedule of components of servicing income. Schedule Of Components Of Servicing Income Schedule of components of servicing income Lessee, Lease, Description [Table]