Revenue (Details) - USD ($) $ in Thousands	3 Months Ended		9 Months Ended
	Sep. 30, 2018	Sep. 30, 2017	Sep. 30, 2018	Sep. 30, 2017
Revenues	$ 633,996	$ 545,922	$ 1,891,399	$ 1,475,111
Direct Financing Lease, Revenue	3,937	2,646	12,517	2,646
Crude Transportation [Member]
Revenues	27,309	18,824	82,025	46,822
Crude Facilities [Member]
Revenues	8,657	9,053	27,762	28,513
Crude Supply and Logistics [Member]
Revenues	434,591	339,874	1,259,709	928,664
HFOTCO LLC [Member]
Revenues	49,728	34,675	139,869	34,675
Direct Financing Lease, Revenue	3,937	2,647	12,517	2,647
SemGas [Member]
Revenues	71,772	54,095	183,177	167,605
SemCAMS [Member]
Revenues	41,939	39,500	156,715	136,412
Corporate, Non-Segment [Member]
Revenues	0	49,902	42,142	132,421
Intersegment Eliminations [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	(15,164)	(13,708)	(42,905)	(38,700)
Revenues	(15,164)	(13,708)	(42,905)	(38,700)
Intersegment Eliminations [Member] | Crude Transportation [Member]
Revenues	7,630	8,988	22,669	22,443
Intersegment Eliminations [Member] | Crude Facilities [Member]
Revenues	2,831	2,567	8,669	7,563
Intersegment Eliminations [Member] | SemGas [Member]
Revenues	4,703	2,152	11,567	8,693
Pipeline transportation [Member] | Crude Transportation [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	22,438	12,497	66,225	25,124
Truck Transportation Revenue [Member] | Crude Transportation [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	12,501	15,315	38,469	44,141
Storage Services [Member] | Crude Facilities [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	7,182	7,484	22,191	22,548
Storage Services [Member] | HFOTCO LLC [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	36,263	27,363	101,247	27,363
Storage Services [Member] | Corporate, Non-Segment [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	0	5,931	7,753	17,772
Service Fees [Member] | Crude Facilities [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	4,306	4,136	14,240	13,528
Service Fees [Member] | HFOTCO LLC [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	9,528	4,665	26,105	4,665
Service Fees [Member] | SemGas [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	18,668	12,741	52,453	40,882
Service Fees [Member] | SemCAMS [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	27,609	25,068	108,553	91,014
Service Fees [Member] | Corporate, Non-Segment [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	0	1,668	3,070	5,138
Product [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	487,693	423,531	1,421,751	1,164,898
Product [Member] | Crude Supply and Logistics [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	434,591	339,874	1,259,709	928,664
Product [Member] | SemGas [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	57,807	43,506	142,291	135,416
Product [Member] | Corporate, Non-Segment [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	0	42,303	31,319	109,511
Other revenue [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	14,526	14,458	48,432	45,600
Other revenue [Member] | SemCAMS [Member]
Revenue from Contract with Customer, Excluding Assessed Tax	$ 14,330	$ 14,432	$ 48,162	$ 45,398