Discontinued Operations - Additional Information (Details) $ in Thousands		3 Months Ended				9 Months Ended
	Jun. 02, 2016 USD ($) loan	Sep. 30, 2016 USD ($)	Jun. 30, 2016 USD ($)	Sep. 30, 2015 USD ($)	[1]	Sep. 30, 2016 USD ($)	Sep. 30, 2015 USD ($)		Jun. 20, 2016 USD ($)
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Percentage of controlling interest owned by the company in OMHHF		83.68%				83.68%
Proceeds from sale of assets						$ 47,562	$ 0
Dividends paid						5,740	0
Tax effect of discontinued operation		$ 475		$ 687		6,235	3,847	[1]
Income taxes		$ 751		$ 1,437		7,190	(1,118)	[1]
Noncontrolling Interest
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Dividends paid						$ 5,740	$ 0
OMHHF
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Percentage of controlling interest owned by the company in OMHHF		83.68%				83.68%
Non-controlling interest percent		16.32%				16.32%
Number of loans insured by U.S. Department of Housing and Urban Development (in loans) | loan	480
Disposal group, including discontinued operation, consideration		$ 3,800				$ 3,800			$ 45,000
Disposal group, including discontinued operation, consideration withheld									$ 1,400
Gain (loss) from disposal of discontinued operation, before income tax	$ 14,900
Business Pipeline of Mortgage Loans
Income Statement, Balance Sheet and Additional Disclosures by Disposal Groups, Including Discontinued Operations [Line Items]
Proceeds from sale of assets		$ 1,400	$ 1,500

[1] Amounts have been recast to reflect discontinued operations. See Note 3 for details.