Note 22 - Business Segments - Segment Operating Results (Details) - USD ($) $ in Thousands		3 Months Ended
		Mar. 31, 2019	Mar. 31, 2018	Dec. 31, 2018
Non-interest revenues		$ 23,649	$ 28,294
Total net revenues after provision for loan losses		27,167	27,211
Non-interest expenses		26,130	34,526
Segment operating pre-tax net income (loss)		967	(5,851)
Assets		221,765	1,101,818	$ 1,391,242
Net interest income (expense)		3,518	3,008
Provision for loan losses			(1,465)
Loss on repurchase, reissuance or early retirement of debt			(2,626)
Non-controlling interest expense		70	(1,464)
Intersegment Eliminations [Member]
Non-interest revenues		(1,014)	(979)
Total net revenues after provision for loan losses		(1,014)	(979)
Non-interest expenses	[1]	(1,014)	(981)
Segment operating pre-tax net income (loss)			2
Assets		(257,129)	(287,419)
Segment Reconciling Items [Member]
Non-interest revenues	[2]	132	(2,213)
Total net revenues after provision for loan losses		327	(4,530)
Non-interest expenses	[1]	1,545	1,124
Segment operating pre-tax net income (loss)		(1,288)	(4,190)
Assets
Net interest income (expense)	[3]	195	881
Provision for loan losses			(572)
Loss on repurchase, reissuance or early retirement of debt			(2,626)
Non-controlling interest expense		70	(1,464)
Broker Dealer [Member]
Non-interest revenues		16,420	25,329
Total net revenues after provision for loan losses		16,420	25,329
Non-interest expenses		17,900	22,916
Segment operating pre-tax net income (loss)		(1,480)	2,413
Assets		46,764	59,619
Asset Management [Member]
Non-interest revenues		2,361	3,989
Total net revenues after provision for loan losses		2,361	3,989
Non-interest expenses		3,090	5,020
Segment operating pre-tax net income (loss)		(729)	(1,031)
Assets		11,053	19,004
Investment Income Segment [Member]
Non-interest revenues		5,751	2,168
Total net revenues after provision for loan losses		9,073	3,402
Non-interest expenses		2,549	4,189
Segment operating pre-tax net income (loss)		6,524	(787)
Assets		116,358	1,017,558
Net interest income (expense)		3,322	2,127
Provision for loan losses			(893)
Corporate Segment [Member]
Non-interest expenses		2,060	2,258
Segment operating pre-tax net income (loss)		(2,060)	(2,258)
Assets		$ 304,719	$ 293,057

[1] Non-interest expense adjustments relate to reversals of share-based and deferred compensation and the amortization expense related to an intangible asset.

[2] Non-interest revenue adjustments are comprised of mark-to-market gains/losses on strategic equity investments and warrants, deferred compensation invested in funds, and unrealized gains or losses on commercial real estate investments, adjusted for non-cash expenditures, included depreciation and amortization.

[3] The net interest income adjustment is comprised of costs related to refinancing and early retirement of debt.