Equity and Share Based Payments - Redeemable Preferred Stock (Details) - USD ($) $ / shares in Units, $ in Thousands	6 Months Ended
Jun. 30, 2020	Dec. 31, 2019
Series B and C Preferred Stock
Equity and Share Based Payments
Outstanding liquidation preference	$ 68,500
Liquidation preference amount per share (in dollars per share)	$ 25.00
Series B 9.375% redeemable preferred stock
Equity and Share Based Payments
Outstanding liquidation preference	$ 33,410	$ 33,410
Series C 9.125% redeemable preferred stock
Equity and Share Based Payments
Outstanding liquidation preference	$ 35,127	$ 35,127
Timm \| Series B 9.375% redeemable preferred stock
Equity and Share Based Payments
Liquidation preference amount per share (in dollars per share)	$ 50.20
Cumulative undeclared dividends in arrears	$ 16,800
Cumulative undeclared dividends in arrears (per share)	$ 25.20
Cumulative undeclared dividends in arrears, increase in every quarter (per share)	$ 0.5859
Amount of increase in cumulative undeclared dividends in arrears in each quarter	$ 390

Aggregate amount of cumulative preferred dividends in arrears increase in every quarter.

No definition available.

Name:	imh_PreferredStockAmountOfPreferredDividendsInArrearsIncreaseInEveryQuarter
Namespace Prefix:	imh_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	duration

- Definition

Per share amount of cumulative preferred dividends in arrears increase in every quarter.

+ References

No definition available.

+ Details

Name:	imh_PreferredStockPerShareAmountsOfPreferredDividendsInArrearsIncreaseInEveryQuarter
Namespace Prefix:	imh_
Data Type:	num:perShareItemType
Balance Type:	na
Period Type:	duration

- Definition

Aggregate amount of cumulative preferred dividends in arrears.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 505
-SubTopic 10
-Section 50
-Paragraph 5
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=109259400&loc=d3e21488-112644

+ Details

Name:	us-gaap_PreferredStockAmountOfPreferredDividendsInArrears
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	duration

- Definition

The per share liquidation preference (or restrictions) of nonredeemable preferred stock (or preferred stock redeemable solely at the option of the issuer) that has a preference in involuntary liquidation considerably in excess of the par or stated value of the shares. The liquidation preference is the difference between the preference in liquidation and the par or stated values of the share.

+ References

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 505
-SubTopic 10
-Section 50
-Paragraph 3
-URI http://asc.fasb.org/extlink&oid=109259400&loc=d3e21475-112644

Reference 2: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 235
-SubTopic 10
-Section S99
-Paragraph 1
-Subparagraph (SX 210.4-08.(d)(1))
-URI http://asc.fasb.org/extlink&oid=26873400&loc=d3e23780-122690

Reference 3: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 210
-SubTopic 10
-Section S99
-Paragraph 1
-Subparagraph (SX 210.5-02(28))
-URI http://asc.fasb.org/extlink&oid=6877327&loc=d3e13212-122682

Reference 4: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 235
-SubTopic 10
-Section S99
-Paragraph 1
-Subparagraph (SX 210.4-08(d)(1))
-URI http://asc.fasb.org/extlink&oid=26873400&loc=d3e23780-122690

Reference 5: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 505
-SubTopic 10
-Section 50
-Paragraph 4
-URI http://asc.fasb.org/extlink&oid=109259400&loc=d3e21484-112644

+ Details

Name:	us-gaap_PreferredStockLiquidationPreference
Namespace Prefix:	us-gaap_
Data Type:	num:perShareItemType
Balance Type:	na
Period Type:	instant

- Definition

Value of the difference between preference in liquidation and the par or stated values of the preferred shares.

+ References

No definition available.

+ Details

Name:	us-gaap_PreferredStockLiquidationPreferenceValue
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant

- Definition

Per share amount of cumulative preferred dividends in arrears.

+ References

+ Details

Name:	us-gaap_PreferredStockPerShareAmountsOfPreferredDividendsInArrears
Namespace Prefix:	us-gaap_
Data Type:	num:perShareItemType
Balance Type:	na
Period Type:	duration

- Definition

Line items represent financial concepts included in a table. These concepts are used to disclose reportable information associated with domain members defined in one or many axes to the table.

+ References

No definition available.

+ Details

Name:	us-gaap_ShareBasedCompensationArrangementByShareBasedPaymentAwardLineItems
Namespace Prefix:	us-gaap_
Data Type:	xbrli:stringItemType
Balance Type:	na
Period Type:	duration

- Details

Name:	us-gaap_StatementClassOfStockAxis=imh_SeriesBAndSeriesCPreferredStockMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_StatementClassOfStockAxis=us-gaap_SeriesBPreferredStockMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	us-gaap_StatementClassOfStockAxis=us-gaap_SeriesCPreferredStockMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type:

- Details

Name:	srt_LitigationCaseAxis=imh_CurtisJTimmMember
Namespace Prefix:
Data Type:	na
Balance Type:
Period Type: