Segment Reporting - Schedule of Segment Financial Information (Details) - USD ($) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2017	Jun. 30, 2016	Jun. 30, 2017	Jun. 30, 2016	Dec. 31, 2016
Segment Reporting Information [Line Items]
Net interest income	$ 30,427	$ 28,358	$ 60,678	$ 54,301
Provision for loan losses	(865)	(789)	(1,122)	(798)
Mortgage banking income	32,079	30,133	57,660	54,636
Mortgage banking income	30,239	30,133	55,319	54,636
Change in fair value of mortgage servicing rights	(1,840)		(2,341)
Other noninterest income	5,418	8,223	11,425	14,755
Depreciation and amortization	991	1,007	1,993	2,022
Amortization of intangibles	123	527	515	1,079
Amortization and impairment of mortgage servicing rights		6,882		9,112
Loss on sale of mortgage servicing rights	249		249
Other noninterest mortgage banking expense	24,791	19,535	47,159	36,789
Other noninterest expense	22,982	22,644	45,637	42,940
Income before income taxes	17,813	16,908	32,991	32,548
Income tax expense	6,574	1,133	11,999	2,174
Net income	11,239	15,775	20,992	30,374
Total assets	3,346,570	2,917,958	3,346,570	2,917,958	$ 3,276,881
Goodwill	46,867	46,867	46,867	46,867	$ 46,867
Banking Segment
Segment Reporting Information [Line Items]
Net interest income	29,999	29,217	59,855	55,231
Provision for loan losses	(865)	(789)	(1,122)	(798)
Mortgage banking income	7,118	7,215	12,784	13,359
Other noninterest income	5,418	8,223	11,425	14,755
Depreciation and amortization	861	901	1,725	1,802
Amortization of intangibles	123	527	515	1,079
Other noninterest mortgage banking expense	5,368	4,072	10,204	7,930
Other noninterest expense	22,982	22,644	45,637	42,940
Income before income taxes	14,066	17,300	27,105	30,392
Total assets	2,878,437	2,508,867	2,878,437	2,508,867
Goodwill	46,767	46,767	46,767	46,767
Mortgage Segment
Segment Reporting Information [Line Items]
Net interest income	428	(859)	823	(930)
Mortgage banking income	24,961	22,918	44,876	41,277
Change in fair value of mortgage servicing rights	(1,840)		(2,341)
Depreciation and amortization	130	106	268	220
Amortization and impairment of mortgage servicing rights		6,882		9,112
Loss on sale of mortgage servicing rights	249		249
Other noninterest mortgage banking expense	19,423	15,463	36,955	28,859
Income before income taxes	3,747	(392)	5,886	2,156
Total assets	468,133	409,091	468,133	409,091
Goodwill	$ 100	$ 100	$ 100	$ 100