Commitments and Contingencies - Corporate-owned Life Insurance Trusts (Details) $ in Thousands	3 Months Ended	6 Months Ended
Mar. 31, 2020 USD ($)	Jun. 30, 2020 USD ($) item
Corporate-owned life insurance trusts
Number of life insurance trusts held for former executive officers \| item		3
Corporate-owned life insurance cash surrender value		$ 10,734
Corporate-owned life insurance liability		12,218
Corporate-owned life insurance short-fall		(1,484)
Consolidation of corporate-owned life insurance trusts	$ (1,281)
Retained Deficit
Corporate-owned life insurance trusts
Consolidation of corporate-owned life insurance trusts	$ (1,281)	(1,300)
Trust #1
Corporate-owned life insurance trusts
Corporate-owned life insurance cash surrender value		4,958
Corporate-owned life insurance liability		5,641
Corporate-owned life insurance short-fall		(683)
Trust #2
Corporate-owned life insurance trusts
Corporate-owned life insurance cash surrender value		3,796
Corporate-owned life insurance liability		4,425
Corporate-owned life insurance short-fall		(629)
Trust #3
Corporate-owned life insurance trusts
Corporate-owned life insurance cash surrender value		1,980
Corporate-owned life insurance liability		2,152
Corporate-owned life insurance short-fall		$ (172)

The adjustment to retained earnings resulting from the consolidation of corporate-owned life insurance trusts.

No definition available.

Name:	imh_ConsolidationOfCorporateOwnedLifeInsurance
Namespace Prefix:	imh_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	duration

- Definition

The amount of shortfall resulting from liability associated with corporate-owned life insurance trusts exceeding the related cash surrender value of the contracts.

+ References

No definition available.

+ Details

Name:	imh_CorporateOwnedLifeInsuranceShortfall
Namespace Prefix:	imh_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Liability associated with corporate-owned life insurance trusts.

+ References

No definition available.

+ Details

Name:	imh_CorporateOwnedLifeInsuranceTrust
Namespace Prefix:	imh_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

The number of life insurance trusts held for former executive officers.

+ References

No definition available.

+ Details

Name:	imh_NumberOfLifeInsuranceTrustsHeldForFormerExecutiveOfficers
Namespace Prefix:	imh_
Data Type:	xbrli:integerItemType
Balance Type:	na
Period Type:	duration

- Definition

Carrying amount as of the balance sheet date of amounts which could be received based on the terms of the insurance contract upon surrendering life policies owned by the entity.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 10
-Section 45
-Paragraph 4
-Subparagraph (d)
-URI http://asc.fasb.org/extlink&oid=118951113&loc=d3e6812-107765

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 10
-Section S99
-Paragraph 1
-Subparagraph (SX 210.5-02.17)
-URI http://asc.fasb.org/extlink&oid=6877327&loc=d3e13212-122682

+ Details

Name:	us-gaap_CashSurrenderValueOfLifeInsurance
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	debit
Period Type:	instant

- Definition

Line items represent financial concepts included in a table. These concepts are used to disclose reportable information associated with domain members defined in one or many axes to the table.

+ References

No definition available.

+ Details

Name:	us-gaap_OtherCommitmentsLineItems
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Details

Name:	us-gaap_StatementEquityComponentsAxis=us-gaap_RetainedEarningsMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_OtherCommitmentsAxis=imh_CorporateOwnedLifeInsuranceTrust1Member
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_OtherCommitmentsAxis=imh_CorporateOwnedLifeInsuranceTrust2Member
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_OtherCommitmentsAxis=imh_CorporateOwnedLifeInsuranceTrust3Member
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type: