Segment Reporting (Details) $ in Thousands	3 Months Ended			6 Months Ended		12 Months Ended
	Jun. 30, 2015 USD ($)	Jun. 30, 2014 USD ($)	Dec. 31, 2013 USD ($) item	Jun. 30, 2015 USD ($)	Jun. 30, 2014 USD ($)	Dec. 31, 2014 USD ($)
Information about the reportable segments and reconciliation to the consolidated financial statements
Number of Reportable Segments | item			3
Revenues:
Interest income	$ 10,694	$ 9,162		$ 20,332	$ 17,539
Gain on loans held for sale	8,617	4,333		14,926	7,543
Insurance and investment services income	965	820		2,663	1,836
Other income	952	1,913		4,356	3,441
Total operating income	21,228	16,228		42,277	30,359
Expenses:
Interest expense	2,268	1,967		4,359	3,347
Salary and employee benefits	10,194	7,932		19,928	14,729
Provision for loan losses	561	889		1,220	1,408
Other expense	5,517	4,256		10,750	8,295
Total operating expenses	18,540	15,044		36,257	27,779
Income before income taxes	2,688	1,184		6,020	2,580
Income tax expense (benefit)	783	215		2,012	453
Net Income	1,905	969		4,008	2,127
Preferred dividends	143	22		285	43
Net Income available to common shareholders	1,762	947		3,723	2,084
Capital expenditures	711	2,666		1,105	4,962
Total assets	1,253,066	1,062,621	$ 987,060	1,253,066	1,062,621	$ 1,110,459
Goodwill	17,779	17,779	17,779	17,779	17,779	17,779
Commercial & Retail Banking
Revenues:
Interest income				18,622	16,123
Gain on loans held for sale				63	(8)
Insurance and investment services income				178	129
Other income				4,068	5,204
Total operating income				22,931	21,448
Expenses:
Interest expense				4,234	3,278
Salary and employee benefits				7,476	6,362
Provision for loan losses				1,220	1,408
Other expense				9,059	7,996
Total operating expenses				21,989	19,044
Income before income taxes				942	2,404
Income tax expense (benefit)				68	375
Net Income	911			874	2,029
Preferred dividends				285	43
Net Income available to common shareholders				589	1,986
Capital expenditures				997	4,428
Total assets	1,390,957	1,143,107	1,021,097	1,390,957	1,143,107	1,189,746
Goodwill	897	897	897	897	897	897
Increase (decrease) in net interest income	1,100			1,500
Increase (decrease) in noninterest income	(528)			1,000
Increase (decrease) in noninterest expense	747,000			2,200
Increase (decrease) in interest exepense	262			956,000
Increase (decrease) in gain on derivative				494
Increase (decrease) in average subordinated debt	29,100			29,200
Increase (decrease) in volume of portfolio loans sold	(8,100)			(8,100)
Increase (decrease) in professional fees				446
Increase (decrease) in dividends on Preferred stock	121			121
Increase (decrease) in occupancy and equipment expense				521
Increase in data processing and communications expense	300			599
Increase (decrease) in average loan balances	173,000			171,800
Increase (decrease) in salaries expense	387			1,100
Increase (decrease) in income from portfolio loans held for sale	204			533
Decrease on gains for security sales	121
Mortgage Banking
Revenues:
Interest income				1,966	1,235
Gain on loans held for sale				15,385	8,139
Other income				2,600	939
Total operating income				19,951	10,313
Expenses:
Interest expense				903	489
Salary and employee benefits				10,664	6,632
Other expense				3,581	2,595
Total operating expenses				15,148	9,716
Income before income taxes				4,803	597
Income tax expense (benefit)				1,838	238
Net Income				2,965	359	400
Net Income available to common shareholders				2,965	359
Capital expenditures				99	191
Total assets	139,767	101,609	92,290	139,767	101,609	101,791
Goodwill	16,882	16,882	16,882	16,882	16,882	16,882
Increase (decrease) in net interest income	198			317,000
Increase (decrease) in noninterest income	3,500			8,900
Increase (decrease) in noninterest expense	2,500			5,000
Increase (decrease) in earnings	769,000			2,600
Increase (decrease) in mortgage fee income	4,200			7,200
Increase (decrease) in gain on derivative	$ 691,000			$ 1,700
Increase (decrease) loan origination volume (as a percent)	69.00%			94.00%
Increase (decrease) in personnel expense	$ 1,900			$ 4,000
Decrease in loans held for sale	9,500
Insurance
Revenues:
Insurance and investment services income				2,485	1,707
Other income				4
Total operating income				2,489	1,707
Expenses:
Salary and employee benefits				1,788	1,735
Other expense				426	393
Total operating expenses				2,214	2,128
Income before income taxes				275	(421)
Income tax expense (benefit)				106	(160)
Net Income	174	(253)		169	(261)
Net Income available to common shareholders				169	(261)
Capital expenditures				9	343
Total assets	4,321	4,431	3,012	4,321	4,431	4,031
Increase (decrease) in net interest income	114
Increase (decrease) in noninterest income				782
Increase (decrease) in noninterest expense	(15)			86
Increase (decrease) in income tax expense	50			266
Operating segments | Commercial & Retail Banking
Revenues:
Interest income	9,719	8,364
Gain on loans held for sale	76	25
Insurance and investment services income	106	71
Other income	2,132	2,746
Total operating income	12,033	11,206
Expenses:
Interest expense	2,193	1,931
Salary and employee benefits	3,718	3,331
Provision for loan losses	561	889
Other expense	4,485	4,125
Total operating expenses	10,957	10,276
Income before income taxes	1,076	930
Income tax expense (benefit)	165	107
Net Income	911	823
Preferred dividends	143	22
Net Income available to common shareholders	768	801
Capital expenditures	638	2,559
Total assets	1,390,957	1,143,107	1,021,097	1,390,957	1,143,107	1,189,746
Goodwill	897	897	897	897	897	897
Operating segments | Mortgage Banking
Revenues:
Interest income	1,137	688
Gain on loans held for sale	8,833	4,649
Other income	(88)	604
Total operating income	9,882	5,941
Expenses:
Interest expense	529	278
Salary and employee benefits	5,574	3,655
Other expense	1,888	1,346
Total operating expenses	7,991	5,279
Income before income taxes	1,891	662
Income tax expense (benefit)	723	263
Net Income	1,168	399
Net Income available to common shareholders	1,168	399
Capital expenditures	71	74
Total assets	139,767	101,609	92,290	139,767	101,609	101,791
Goodwill	16,882	16,882	16,882	16,882	16,882	16,882
Operating segments | Insurance
Revenues:
Insurance and investment services income	859	749
Other income	4
Total operating income	863	749
Expenses:
Salary and employee benefits	902	946
Other expense	240	211
Total operating expenses	1,142	1,157
Income before income taxes	(279)	(408)
Income tax expense (benefit)	(105)	(155)
Net Income	(174)	(253)
Net Income available to common shareholders	(174)	(253)
Capital expenditures	2	33
Total assets	4,321	4,431	3,012	4,321	4,431	4,031
Intercompany Eliminations
Revenues:
Interest income	(162)	110		(256)	181
Gain on loans held for sale	(292)	(341)		(522)	(588)
Other income	(1,096)	(1,437)		(2,316)	(2,702)
Total operating income	(1,550)	(1,668)		(3,094)	(3,109)
Expenses:
Interest expense	(454)	(242)		(778)	(420)
Other expense	(1,096)	(1,426)		(2,316)	(2,689)
Total operating expenses	(1,550)	(1,668)		(3,094)	(3,109)
Total assets	$ (281,979)	$ (186,526)	$ (129,339)	$ (281,979)	$ (186,526)	$ (185,109)