Segment Reporting (Details) $ in Thousands	3 Months Ended			9 Months Ended		12 Months Ended
	Sep. 30, 2015 USD ($)	Sep. 30, 2014 USD ($)	Dec. 31, 2013 USD ($) item	Sep. 30, 2015 USD ($)	Sep. 30, 2014 USD ($)	Dec. 31, 2014 USD ($)
Information about the reportable segments and reconciliation to the consolidated financial statements
Number of Reportable Segments | item			3
Revenues:
Interest income	$ 11,416	$ 9,094		$ 31,748	$ 26,632
Gain on loans held for sale	8,955	4,948		23,881	12,491
Insurance and investment services income	1,142	909		3,805	2,745
Other income	(143)	723		4,213	4,166
Total operating income	21,370	15,674		63,647	46,034
Expenses:
Interest expense	2,398	2,036		6,757	5,383
Salary and employee benefits	10,203	7,598		30,131	22,327
Provision for loan losses	636	783		1,856	2,192
Other expense	6,221	4,617		16,971	12,912
Total operating expenses	19,458	15,034		55,715	42,814
Income before income taxes	1,912	640		7,932	3,220
Income tax expense (benefit)	506	103		2,518	556
Net Income	1,406	537		5,414	2,664
Preferred dividends	145	144		430	187
Net Income available to common shareholders	1,261	393		4,984	2,477
Capital expenditures	543	3,023		1,648	7,985
Total assets	1,306,529	1,086,814	$ 987,060	1,306,529	1,086,814	$ 1,110,459
Goodwill	18,480	17,779	17,779	18,480	17,779	17,779
Commercial & Retail Banking
Revenues:
Interest income				29,049	24,399
Gain on loans held for sale				36	31
Insurance and investment services income				276	192
Other income				6,658	6,912
Total operating income				36,019	31,534
Expenses:
Interest expense				6,568	5,276
Salary and employee benefits				11,457	9,644
Provision for loan losses				1,856	2,192
Other expense				14,284	11,325
Total operating expenses				34,165	28,437
Income before income taxes				1,854	3,097
Income tax expense (benefit)				188	490
Net Income	646	432		1,666	2,607
Preferred dividends				430	187
Net Income available to common shareholders				1,236	2,420
Capital expenditures				1,487	7,371
Total assets	1,460,120	1,186,006	1,021,097	1,460,120	1,186,006	1,189,746
Goodwill	1,598	897	897	1,598	897	897
Increase (decrease) in net interest income	1,800			3,400
Increase (decrease) in noninterest income	851			(165)
Increase (decrease) in noninterest expense	2,600			4,800
Increase (decrease) in interest expense	362			1,400
Increase (decrease) in interest expense on subordinated debt				1,100
Increase (decrease) in average subordinated debt	165,300			142,200
Increase (decrease) in gain on sale of other real estate owned	618			597
Increase (decrease) in swap fee income	382			382
Increase (decrease) in other operating income	519			303
Increase (decrease) in other operating expense	824
Increase (decrease) in debit card income and interchange income				111
Increase (decrease) in gain on sale of securities	(267)
Increase (decrease) in gain on sale of portfolio loans				266
Increase (decrease) in derivative valuation	(496)			430
Increase (decrease) in professional fees	293			739
Increase (decrease) in dividends on Preferred stock				243
Increase (decrease) in occupancy and equipment expense	292			813
Increase in data processing and communications expense	360			959
Increase (decrease) in average loan balances	208,700			193,400
Increase (decrease) in salaries expense	701			1,800
Increase (decrease) in income from portfolio loans held for sale	(104)
Increase (decrease) in noninterest expense related merger and acquisition costs	502			359
Mortgage Banking
Revenues:
Interest income				2,996	1,959
Gain on loans held for sale				24,678	13,362
Other income				1,056	548
Total operating income				28,730	15,869
Expenses:
Interest expense				1,319	776
Salary and employee benefits				15,967	10,105
Other expense				5,474	4,225
Total operating expenses				22,760	15,106
Income before income taxes				5,970	763
Income tax expense (benefit)				2,287	305
Net Income				3,683	458	101
Net Income available to common shareholders				3,683	458
Capital expenditures				152	262
Total assets	110,119	82,648	92,290	110,119	82,648	101,791
Goodwill	16,882	16,882	16,882	16,882	16,882	16,882
Increase (decrease) in net interest income	176			494,000
Increase (decrease) in noninterest income	2,900			11,800
Increase (decrease) in noninterest expense	2,100			7,100
Increase (decrease) in earnings	719,000			3,200
Increase (decrease) in mortgage fee income	4,100			11,300
Increase (decrease) in gain on derivative	$ 1,200			$ 511,000
Increase (decrease) loan origination volume (as a percent)	59.00%			82.00%
Increase (decrease) in personnel expense	$ 1,800			$ 5,900
Decrease in loans held for sale	43,300
Insurance
Revenues:
Insurance and investment services income				3,529	2,553
Other income				6
Total operating income				3,535	2,553
Expenses:
Salary and employee benefits				2,707	2,578
Other expense				720	615
Total operating expenses				3,427	3,193
Income before income taxes				108	(640)
Income tax expense (benefit)				43	(239)
Net Income	104	(140)		65	(401)
Net Income available to common shareholders				65	(401)
Capital expenditures				9	352
Total assets	2,944	2,804	3,012	2,944	2,804	4,031
Increase (decrease) in net interest income	199
Increase (decrease) in noninterest income				982
Increase (decrease) in noninterest expense	(147)			234
Increase (decrease) in income tax expense	16			282
Operating segments | Commercial & Retail Banking
Revenues:
Interest income	10,427	8,277
Gain on loans held for sale	(28)	39
Insurance and investment services income	98	63
Other income	2,589	1,706
Total operating income	13,086	10,085
Expenses:
Interest expense	2,333	1,999
Salary and employee benefits	3,982	3,281
Provision for loan losses	636	783
Other expense	5,223	3,330
Total operating expenses	12,174	9,393
Income before income taxes	912	692
Income tax expense (benefit)	121	116
Net Income	791	576
Preferred dividends	145	144
Net Income available to common shareholders	646	432
Capital expenditures	490	2,943
Total assets	1,460,120	1,186,006	1,021,097	1,460,120	1,186,006	1,189,746
Goodwill	1,598	897	897	1,598	897	897
Operating segments | Mortgage Banking
Revenues:
Interest income	1,029	725
Gain on loans held for sale	9,293	5,223
Other income	(1,544)	(391)
Total operating income	8,778	5,557
Expenses:
Interest expense	415	287
Salary and employee benefits	5,302	3,473
Other expense	1,894	1,630
Total operating expenses	7,611	5,390
Income before income taxes	1,167	167
Income tax expense (benefit)	448	66
Net Income	719	101
Net Income available to common shareholders	719	101
Capital expenditures	53	71
Total assets	110,119	82,648	92,290	110,119	82,648	101,791
Goodwill	16,882	16,882	16,882	16,882	16,882	16,882
Operating segments | Insurance
Revenues:
Insurance and investment services income	1,044	846
Other income	1
Total operating income	1,045	846
Expenses:
Salary and employee benefits	919	844
Other expense	293	221
Total operating expenses	1,212	1,065
Income before income taxes	(167)	(219)
Income tax expense (benefit)	(63)	(79)
Net Income	(104)	(140)
Net Income available to common shareholders	(104)	(140)
Capital expenditures		9
Total assets	2,944	2,804	3,012	2,944	2,804	4,031
Intercompany Eliminations
Revenues:
Interest income	(40)	92		(297)	274
Gain on loans held for sale	(310)	(314)		(833)	(902)
Other income	(1,189)	(592)		(3,507)	(3,294)
Total operating income	(1,539)	(814)		(4,637)	(3,922)
Expenses:
Interest expense	(350)	(250)		(1,130)	(669)
Other expense	(1,189)	(564)		(3,507)	(3,253)
Total operating expenses	(1,539)	(814)		(4,637)	(3,922)
Total assets	$ (266,654)	$ (184,644)	$ (129,339)	$ (266,654)	$ (184,644)	$ (185,109)