Income Taxes - Narrative (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2020	Mar. 31, 2019	Sep. 01, 2018	Dec. 31, 2015
Operating Loss Carryforwards [Line Items]
Income taxes	$ 773	$ 13,590
Effective income tax rate	27.80%	23.15%
Domestic tax authority | Brand
Operating Loss Carryforwards [Line Items]
Operating loss carryforwards	$ 21,086		$ 81,288
Domestic tax authority | Heritage financial group
Operating Loss Carryforwards [Line Items]
Operating loss carryforwards	3,751			$ 18,321
State and local jurisdiction | Brand
Operating Loss Carryforwards [Line Items]
Operating loss carryforwards	34,477		$ 55,067
State and local jurisdiction | Heritage financial group
Operating Loss Carryforwards [Line Items]
Operating loss carryforwards	$ 3,072			$ 16,849