Discontinued Operations - Additional Information (Details)		3 Months Ended		6 Months Ended
	Jun. 02, 2016 USD ($) loan	Sep. 30, 2016 USD ($)	Jun. 30, 2016 USD ($)	Jun. 30, 2017 USD ($)	Jun. 30, 2016 USD ($)	Jun. 20, 2016 USD ($)
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Percentage of controlling interest owned by the company in OMHHF				83.68%
Proceeds from sale of assets				$ 0	$ 43,252,000
Dividends paid to noncontrolling interest				816,000	$ 0
Noncontrolling Interest
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Dividends paid to noncontrolling interest				$ 816,000
OMHHF
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Percentage of controlling interest owned by the company in OMHHF				83.68%
Non-controlling interest percent				16.32%
Number of loans insured by U.S. Department of Housing and Urban Development (in loans) | loan	480
Disposal group, including discontinued operation, consideration		$ 3,800,000				$ 45,000,000
Disposal group, including discontinued operation, consideration withheld						$ 1,400,000
Gain (loss) from disposal of discontinued operation, before income tax	$ 14,900,000
Dividends paid to noncontrolling interest				$ 816,000
Payments for Repurchase of Convertible Preferred Stock				$ 5,000,000
Business Pipeline of Mortgage Loans
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Proceeds from sale of assets		$ 1,400,000	$ 1,500,000