Discontinued Operations Discontinued Operations Assets and Liabilities Table (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2016	Dec. 31, 2015	Dec. 31, 2014
Carrying value of loan servicing rights	$ 0	$ 28,168	$ 30,140
Assets held for sale	5,188	99,881
Liabilities held for sale	1,217	74,680
Oppenheimer Multi Family Housing And Healthcare Finance [Member]
Cash Dividends Paid to Parent Company	29,400
Disposal Group, Including Discontinued Operation, Interest Income	943	1,999	1,739
Disposal group, Including discontinued operations, Securities Owned	3,560	562
Mortgages Held-for-sale, Fair Value Disclosure	0	60,234
Carrying value of loan servicing rights	0	28,168
Disposal Group, Including Discontinued Operation, Other Assets	1,628	10,917
Assets held for sale	5,188	99,881
Disposal Group, Including Discontinued Operation, Accounts Payable and Accrued Liabilities	1,217	64,124
Disposal Group, Including Discontinued Operation, Deferred Tax Liabilities	0	10,556
Liabilities held for sale	1,217	74,680
Disposal Group, Including Discontinued Operation, Principal Transactions	(9,022)	5,323	2,184
Disposal Group, including discontinued operations, Gain on Sale of Assets	16,475	0	0
Disposal Group, Not Discontinued Operation, Gain (Loss) on Disposal	16,917	23,262	19,406
Disposal Group, Including Discontinued Operation, Revenue	25,313	30,584	23,329
Disposal Group, Including Discontinued Operation, Compensation and Related Expenses	4,311	12,406	10,245
Disposal Group, Including Discontinued Operation, Communications and Technology	221	361	420
Disposal Group, Including Discontinued Operation, Communications and Technology	(14,097)	3,322	6,877
Cash Provided by (Used in) Investing Activities, Discontinued Operations	45,448	0	0
Disposal Group, Including Discontinued Operation, Occupancy and Equipment	415	302	341
Disposal Group, Including Discontinued Operation, Interest Expense	408	994	845
Disposal Group, Including Discontinued Operation, Other Expense	2,619	7,382	2,932
Disposal Group, Including Discontinued Operation, Operating Expense	7,974	21,445	14,783
Disposal Group, Including Discontinued Operation, Gross Profit (Loss)	17,339	9,139	8,546
Income (Loss) from Discontinued Operations, before tax, Attributable to Noncontrolling Interest	2,830	1,491	1,395
Cash Provided by (Used in) Financing Activities, Discontinued Operations	(35,421)	(249)	(251)
Net Cash Provided by (Used in) Discontinued Operations	$ (4,070)	$ 3,073	$ 6,626