Segments (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2018	Mar. 31, 2017	Dec. 31, 2017
Segment Reporting Information [Line Items]
Revenue, Net	$ 661,609	$ 456,100
Income (Loss) from Equity Method Investments and Issuance of Common Units by Equity Method Investee	12,614	17,091
Depreciation and amortization		24,599
Income tax expense	23,083	95
General and Administrative Expense	26,477	21,712
Loss (gain) on disposal or impairment	3,566	(2,410)
Interest Expense	42,461	13,867
Loss on early extinguishment of debt	0	19,922
Foreign currency transaction loss	3,294	0
Other expense (income), net	(950)	(218)
Net loss	(33,035)	(10,277)
Total assets	5,439,325		$ 5,376,817
Equity method investments	279,054		285,281
Crude Transportation [Member]
Segment Reporting Information [Line Items]
Revenue, Net	26,068	13,979
SemCAMS [Member]
Segment Reporting Information [Line Items]
Revenue, Net	45,145	36,798
SemGas [Member]
Segment Reporting Information [Line Items]
Revenue, Net	52,237	57,752
Crude Facilities [Member]
Segment Reporting Information [Line Items]
Revenue, Net	9,284	9,635
Crude Supply and Logistics [Member]
Segment Reporting Information [Line Items]
Revenue, Net	443,399	297,471
HFOTCO LLC [Member]
Segment Reporting Information [Line Items]
Revenue, Net	44,198	0
Corporate and Reconciling Items And Eliminations [Member]
Segment Reporting Information [Line Items]
Revenue, Net	41,278	40,465
Income (Loss) from Equity Method Investments and Issuance of Common Units by Equity Method Investee	9	3
Depreciation and amortization	742	3,243
Income tax expense	19,904	(1,329)
Segment profit	10,963	8,367
Total assets	418,017		271,806
Equity method investments	18,928		18,919
Operating Segments [Member] | Crude Transportation [Member]
Segment Reporting Information [Line Items]
Income (Loss) from Equity Method Investments and Issuance of Common Units by Equity Method Investee	12,605	17,088
Depreciation and amortization	12,476	5,927
Segment profit	34,310	28,251
Total assets	1,032,730		1,039,399
Equity method investments	260,126		266,362
Operating Segments [Member] | SemCAMS [Member]
Segment Reporting Information [Line Items]
Depreciation and amortization	5,238	4,496
Income tax expense	2,970	1,424
Segment profit	22,113	16,865
Total assets	561,857		518,900
Operating Segments [Member] | SemGas [Member]
Segment Reporting Information [Line Items]
Depreciation and amortization	10,449	8,927
Segment profit	14,277	18,227
Total assets	720,827		714,777
Operating Segments [Member] | Crude Facilities [Member]
Segment Reporting Information [Line Items]
Depreciation and amortization	2,132	1,944
Segment profit	9,341	9,564
Total assets	148,520		153,953
Operating Segments [Member] | Crude Supply and Logistics [Member]
Segment Reporting Information [Line Items]
Depreciation and amortization	193	62
Segment profit	(6,583)	(2,428)
Total assets	545,551		674,684
Operating Segments [Member] | HFOTCO LLC [Member]
Segment Reporting Information [Line Items]
Depreciation and amortization	19,306	0
Income tax expense	209	0
Segment profit	30,988	0
Total assets	2,011,823		$ 2,003,298
Intersegment Eliminations [Member]
Segment Reporting Information [Line Items]
Revenue, Net	(14,859)	(12,971)
Intersegment Eliminations [Member] | Crude Transportation [Member]
Segment Reporting Information [Line Items]
Revenue, Net	8,208	6,554
Intersegment Eliminations [Member] | SemGas [Member]
Segment Reporting Information [Line Items]
Revenue, Net	3,658	3,911
Intersegment Eliminations [Member] | Crude Facilities [Member]
Segment Reporting Information [Line Items]
Revenue, Net	2,993	2,506
Operating segments and corporate nonsegment [Member]
Segment Reporting Information [Line Items]
Segment profit	115,409	78,846
Segment Reconciling Items [Member]
Segment Reporting Information [Line Items]
Depreciation and amortization	50,536	24,599
EBITDA Adjustment to Equity Earnings	4,883	6,709
Net unrealized loss related to commodity derivative instruments	2,226	27
General and Administrative Expense	$ 26,477	$ 21,712