Subordinated Debentures and Subordinated Notes Payable - Junior Subordinated Deferrable Interest Debentures (Details) $ / shares in Units, $ in Thousands	3 Months Ended	12 Months Ended
	Dec. 31, 2016 USD ($) trust $ / shares shares	Sep. 30, 2016 USD ($)
Debt Instrument [Line Items]
Maximum interest payment deferral period	5 years
Total subordinated debentures and subordinated notes payable	$ 108,178	$ 111,873
Junior Subordinated Debt
Debt Instrument [Line Items]
Total subordinated debentures and subordinated notes payable	73,442	77,155
Common shares held in other assets	$ 2,520	$ 2,520
Junior Subordinated Debt | HF Capital Trust V, variable rate of 1.83%, plus 3 month LIBOR
Debt Instrument [Line Items]
Basis spread on variable rate (as a percent)	1.83%	1.83%
Common shares held in other assets	$ 310	$ 310
Number of shares redeemed (in shares) | shares	5,000
Trust Preferred Securities Subject to Mandatory Redemption
Debt Instrument [Line Items]
Number of trusts | trust	7
Number of shares caused to be issued (in shares) | shares	73,400
Par value per shares issued (in dollars per share) | $ / shares	$ 1,000
Trust Preferred Securities Subject to Mandatory Redemption | London Interbank Offered Rate (LIBOR) | Minimum
Debt Instrument [Line Items]
Basis spread on variable rate (as a percent)	1.48%
Trust Preferred Securities Subject to Mandatory Redemption | London Interbank Offered Rate (LIBOR) | Maximum
Debt Instrument [Line Items]
Basis spread on variable rate (as a percent)	3.35%