Investments in Equity Affiliates, Additional Information (Details) - USD ($) $ in Thousands	3 Months Ended
Mar. 31, 2018	Mar. 31, 2017
Investment in Equity Affiliates
(Loss) income from equity affiliates	$ 746	$ 763
Arbor Residential Investor LLC \| Non-qualified Residential Mortgages
Investment in Equity Affiliates
Distributions received	200
Arbor Residential Investor LLC \| Non Qualified and Additional Residential Mortgages \| Maximum
Investment in Equity Affiliates
(Loss) income from equity affiliates	100	100
Arbor Residential Investor LLC \| Residential Mortgage Banking Company
Investment in Equity Affiliates
(Loss) income from equity affiliates	100	100
Charge for proportionate share of litigation settlement recorded	2,400
Lexford Portfolio
Investment in Equity Affiliates
(Loss) income from equity affiliates	$ 600	$ 700

This item represents the entity's proportionate share for the period of the net income (loss) of its investee (such as unconsolidated subsidiaries and joint ventures) to which the equity method of accounting is applied. This item includes income or expense related to stock-based compensation based on the investor's grant of stock to employees of an equity method investee.

Reference 1: http://www.xbrl.org/2003/role/presentationRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 225
-SubTopic 10
-Section S99
-Paragraph 2
-Subparagraph (SX 210.5-03(12))
-URI http://asc.fasb.org/extlink&oid=63488584&loc=d3e20235-122688

Reference 2: http://www.xbrl.org/2003/role/presentationRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 944
-SubTopic 225
-Section S99
-Paragraph 1
-Subparagraph (SX 210.7-04(10))
-URI http://asc.fasb.org/extlink&oid=6879464&loc=d3e573970-122913

Reference 3: http://www.xbrl.org/2003/role/presentationRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 230
-SubTopic 10
-Section 45
-Paragraph 28
-Subparagraph (b)
-URI http://asc.fasb.org/extlink&oid=98514028&loc=d3e3602-108585

Reference 4: http://www.xbrl.org/2003/role/presentationRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 323
-SubTopic 10
-Section 45
-Paragraph 1
-URI http://asc.fasb.org/extlink&oid=66022249&loc=d3e33749-111570

Reference 5: http://www.xbrl.org/2003/role/presentationRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 942
-SubTopic 225
-Section S99
-Paragraph 1
-Subparagraph (SX 210.9-04(13)(f))
-URI http://asc.fasb.org/extlink&oid=6879574&loc=d3e536633-122882

Name:	us-gaap_IncomeLossFromEquityMethodInvestments
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	duration