Segment Reporting - Schedule of Segment Financial Information (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2017	Mar. 31, 2016	Dec. 31, 2016
Segment Reporting Information [Line Items]
Net interest income	$ 30,251	$ 25,943
Provision for loan losses	(257)	(9)
Mortgage banking income	25,080	24,503
Other noninterest income	6,007	6,532
Depreciation and amortization	1,002	1,015
Amortization of intangibles	392	552
Amortization and impairment of mortgage servicing rights		2,914
Other noninterest mortgage banking expense	22,368	16,570
Other noninterest expense	22,655	20,296
Income before income taxes	15,178	15,640
Income tax expense	5,425	1,041
Net income	9,753	14,599
Total assets	3,166,459	2,855,563	$ 3,276,881
Goodwill	46,867	46,867	$ 46,867
Banking Segment
Segment Reporting Information [Line Items]
Net interest income	29,856	26,014
Provision for loan losses	(257)	(9)
Mortgage banking income	5,666	6,147
Other noninterest income	6,007	6,532
Depreciation and amortization	864	901
Amortization of intangibles	392	552
Other noninterest mortgage banking expense	4,836	3,858
Other noninterest expense	22,655	20,296
Income before income taxes	13,039	13,095
Total assets	2,705,118	2,532,060
Goodwill	46,767	46,767
Mortgage Segment
Segment Reporting Information [Line Items]
Net interest income	395	(71)
Mortgage banking income	19,414	18,356
Depreciation and amortization	138	114
Amortization and impairment of mortgage servicing rights		2,914
Other noninterest mortgage banking expense	17,532	12,712
Income before income taxes	2,139	2,545
Total assets	461,341	323,503
Goodwill	$ 100	$ 100