Segments (Details) - USD ($) $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2017	Sep. 30, 2017	Jun. 30, 2017	Mar. 31, 2017	Dec. 31, 2016	Sep. 30, 2016	Jun. 30, 2016	Mar. 31, 2016	Dec. 31, 2017	Dec. 31, 2016	Dec. 31, 2015
Segment Reporting Information
Revenue	$ 606,806	$ 545,922	$ 473,089	$ 456,100	$ 402,172	$ 327,764	$ 287,377	$ 314,851	$ 2,081,917	$ 1,332,164	$ 1,455,094
Earnings from equity method investments									67,331	73,716	87,771
Depreciation and amortization expense									158,421	98,804	100,882
Loss (gain) on disposal or impairment	(30,468)	41,625	(234)	2,410	38	1,018	1,685	13,307	13,333	16,048	11,472
Income tax expense (benefit)	31,141	(37,249)	3,625	95	16,119	11,898	4,658	(21,407)	(2,388)	11,268	33,530
Additions to long-lived assets									2,521,080	324,681	526,444
Total assets	5,376,817				3,074,972				5,376,817	3,074,972
Equity method investments	285,281				434,289				285,281	434,289
General and Administrative Expense									110,373	83,908	97,366
Interest expense									103,009	62,650	69,675
Loss on early extinguishment of debt									19,930	0	0
Foreign currency transaction loss (gain)									(4,709)	4,759	(1,067)
Loss (gain) on sale or impairment of non-operated equity method investment									0	30,644	(14,517)
Other expense (income), net									(1,226)	(994)	(1,284)
Loss from Discontinued Operations, Net of Tax, Including Portion Attributable to Noncontrolling Interest					0	(3)	2	2	0	1	4
Net income (loss)	2,619	$ (19,103)	$ 9,611	$ (10,277)	12,000	$ (4,632)	$ 10,787	$ (4,893)	(17,150)	13,262	42,812
Crude Transportation [Member]
Segment Reporting Information
Revenue									74,993	64,853	81,991
Crude Facilities [Member]
Segment Reporting Information
Revenue									42,327	45,956	45,936
Crude Supply and Logistics [Member]
Segment Reporting Information
Revenue									1,299,343	716,570	716,784
HFOTCO LLC [Member]
Segment Reporting Information
Revenue									76,885	0	0
SemGas [Member]
Segment Reporting Information
Revenue									222,048	208,042	231,569
SemCAMS [Member]
Segment Reporting Information
Revenue									183,232	133,216	136,197
Corporate and reconciling items [Member]
Segment Reporting Information
Revenue									183,089	163,527	242,617
Earnings from equity method investments									(14)	2,147	11,416
Depreciation and amortization expense									14,094	13,318	14,651
Income tax expense (benefit)									(11,613)	7,601	28,683
Segment profit									33,237	39,534	56,822
Additions to long-lived assets									18,062	28,020	21,259
Total assets	271,806				327,526				271,806	327,526
Equity method investments	18,919				18,933				18,919	18,933
Operating segments and corporate nonsegment [Member]
Segment Reporting Information
Segment profit									406,523	350,096	373,852
Segment Reconciling Items [Member]
Segment Reporting Information
Depreciation and amortization expense									158,421	98,804	100,882
Loss (gain) on disposal or impairment									13,333	16,048	11,472
Income tax expense (benefit)									(2,388)	11,268	33,530
EBITDA Adjustment to Equity Earnings									26,890	28,757	32,965
Net unrealized (gain) loss related to derivative instruments									40	989	2,014
General and Administrative Expense									110,373	83,908	97,366
Interest expense									103,009	62,650	69,675
Loss on early extinguishment of debt									19,930	0	0
Foreign currency transaction loss (gain)									(4,709)	4,759	(1,067)
Loss (gain) on sale or impairment of non-operated equity method investment									0	30,644	(14,517)
Other expense (income), net									(1,226)	(994)	(1,284)
Loss from Discontinued Operations, Net of Tax, Including Portion Attributable to Noncontrolling Interest									0	1	4
Operating Segments [Member] | Crude Transportation [Member]
Segment Reporting Information
Earnings from equity method investments									67,345	71,569	76,355
Depreciation and amortization expense									35,953	24,483	35,500
Segment profit									133,505	119,726	125,120
Additions to long-lived assets									262,728	230,139	219,227
Total assets	1,039,399				1,042,327				1,039,399	1,042,327
Equity method investments	266,362				415,356				266,362	415,356
Operating Segments [Member] | Crude Facilities [Member]
Segment Reporting Information
Depreciation and amortization expense									8,113	7,781	5,829
Segment profit									41,967	47,039	37,351
Additions to long-lived assets									4,775	6,439	30,118
Total assets	153,953				156,907				153,953	156,907
Operating Segments [Member] | Crude Supply and Logistics [Member]
Segment Reporting Information
Depreciation and amortization expense									400	185	159
Segment profit									(7,801)	24,003	30,899
Additions to long-lived assets									2,233	3,664	2,564
Total assets	674,684				484,475				674,684	484,475
Operating Segments [Member] | HFOTCO LLC [Member]
Segment Reporting Information
Depreciation and amortization expense									44,272	0	0
Income tax expense (benefit)									362	0	0
Segment profit									61,536	0	0
Additions to long-lived assets									2,019,482	0	0
Total assets	2,003,298				0				2,003,298	0
Operating Segments [Member] | SemGas [Member]
Segment Reporting Information
Depreciation and amortization expense									37,059	36,170	31,803
Segment profit									67,805	66,530	73,422
Additions to long-lived assets									100,537	21,913	110,908
Total assets	714,777				683,952				714,777	683,952
Operating Segments [Member] | SemCAMS [Member]
Segment Reporting Information
Depreciation and amortization expense									18,530	16,867	12,940
Income tax expense (benefit)									8,863	3,667	4,847
Segment profit									76,274	53,264	50,238
Additions to long-lived assets									113,263	34,506	142,368
Total assets	$ 518,900				$ 379,785				518,900	379,785
Intersegment Eliminations [Member]
Segment Reporting Information
Revenue									(53,703)	(48,480)	(35,626)
Intersegment Eliminations [Member] | Crude Transportation [Member]
Segment Reporting Information
Revenue									31,939	26,878	15,021
Intersegment Eliminations [Member] | Crude Facilities [Member]
Segment Reporting Information
Revenue									10,594	10,674	0
Intersegment Eliminations [Member] | SemGas [Member]
Segment Reporting Information
Revenue									$ 11,170	$ 10,928	$ 20,605