Segment Information (Details) (USD $)	3 Months Ended			15 Months Ended	12 Months Ended
	Mar. 31, 2015	Mar. 31, 2014	Dec. 31, 2013 item	Mar. 31, 2015	Dec. 31, 2014
Information about the reportable segments and reconciliation to the consolidated financial statements
Number of Reportable Segments			3
Revenues:
Interest income	$ 9,787,000	$ 8,509,000
Gain on loans held for sale	6,309,000	3,210,000
Insurance and investment services income	1,698,000	1,016,000
Other income	3,404,000	2,731,000
Total operating income	21,198,000	15,466,000
Expenses:
Interest expense	2,240,000	1,513,000
Salaries and employee benefits	9,734,000	6,797,000
Provision for loan losses	659,000	519,000
Other expense	5,233,000	5,241,000
Total operating expenses	17,866,000			14,070,000
Income (loss) before income taxes	3,332,000	1,396,000
Income tax expense (benefit)	1,229,000	238,000
Net Income	2,103,000	1,158,000
Preferred dividends	142,000	21,000
Net Income available to common shareholders	1,961,000	1,137,000
Capital expenditures	394,000	2,296,000
Total assets	1,194,973,000	997,425,000	987,060,000	1,194,973,000	1,110,459,000
Goodwill	17,779,000	17,779,000	17,779,000	17,779,000	17,779,000
Commercial & Retail Banking
Expenses:
Increase (decrease) in net interest income	451,000
Increase (decrease) in noninterest income	(490,000)
Increase (decrease) in noninterest expense	1,600,000
Increase (decrease) in interest exepense	524,000
Increase (decrease) in average subordinated debt	29,400,000
Increase (decrease) in volume of portfolio loans sold	(18,000,000)
Increase (decrease) in professional fees	181,000
Increase (decrease) in dividends on Preferred stock	121,000
Increase (decrease) in occupancy and equipment expense	247,000
Increase (decrease) in data processing expense	299,000
Increase (decrease) in average loan balances	172,100,000
Increase (decrease) in salaries expense	727,000
Increase (decrease) in income from portfolio loans held for sale	330,000
Increase (decrease) in the provision for loan losses	140,000
Mortgage Banking
Expenses:
Increase (decrease) in net interest income	120,000
Increase (decrease) in noninterest income	5,400,000
Increase (decrease) in noninterest expense	2,600,000
Increase (decrease) in earnings	1,900,000
Increase (decrease) in mortgage fee income	3,100,000
Increase (decrease) in gain on derivative	2,400,000
Increase (decrease) loan origination volume (as a percent)	(126.00%)
Increase (decrease) in personnel expense	2,100,000
Insurance
Expenses:
Increase (decrease) in net interest income	669,000
Increase (decrease) in noninterest expense	(102,000)
Increase (decrease) in income tax expense	224,000
Operating segments | Commercial & Retail Banking
Revenues:
Interest income	8,904,000	7,758,000
Gain on loans held for sale	(13,000)	(32,000)
Insurance and investment services income	71,000	58,000
Other income	1,937,000	2,459,000
Total operating income	10,899,000	10,243,000			1,200,000
Expenses:
Interest expense	2,042,000	1,347,000
Salaries and employee benefits	3,757,000	3,030,000
Provision for loan losses	659,000	519,000
Other expense	4,576,000	3,872,000
Total operating expenses	11,034,000			8,768,000
Income (loss) before income taxes	(135,000)	1,475,000
Income tax expense (benefit)	(97,000)	268,000
Net Income	(38,000)	1,207,000
Preferred dividends	142,000	21,000
Net Income available to common shareholders	(180,000)	1,186,000
Capital expenditures	359,000	1,869,000
Total assets	1,345,359,000	1,050,763,000	1,021,097,000	1,345,359,000	1,189,746,000
Goodwill	897,000	897,000	897,000	897,000	897,000
Operating segments | Mortgage Banking
Revenues:
Interest income	978,000	680,000
Gain on loans held for sale	6,551,000	3,490,000
Other income	2,688,000	335,000
Total operating income	10,217,000	4,505,000			41,000
Expenses:
Interest expense	522,000	344,000
Salaries and employee benefits	5,091,000	2,977,000
Other expense	1,691,000	1,250,000
Total operating expenses	7,304,000			4,571,000
Income (loss) before income taxes	2,913,000	(66,000)
Income tax expense (benefit)	1,115,000	(25,000)
Net Income	1,798,000	(41,000)
Net Income available to common shareholders	1,798,000	(41,000)
Capital expenditures	28,000	117,000
Total assets	160,054,000	86,407,000	92,290,000	160,054,000	101,791,000
Goodwill	16,882,000	16,882,000	16,882,000	16,882,000	16,882,000
Operating segments | Insurance
Revenues:
Insurance and investment services income	1,627,000	958,000
Total operating income	1,627,000	958,000			(8,000)
Expenses:
Salaries and employee benefits	886,000	790,000
Other expense	187,000	181,000
Total operating expenses	1,073,000			971,000
Income (loss) before income taxes	554,000	(13,000)
Income tax expense (benefit)	211,000	(5,000)
Net Income	343,000	(8,000)
Net Income available to common shareholders	343,000	(8,000)
Capital expenditures	7,000	310,000
Total assets	4,188,000	4,059,000	3,012,000	4,188,000	4,031,000
Intercompany Eliminations
Revenues:
Interest income	(95,000)	71,000
Gain on loans held for sale	(229,000)	(248,000)
Other income	(1,221,000)	(63,000)
Total operating income	(1,545,000)	(240,000)
Expenses:
Interest expense	(324,000)	(178,000)
Other expense	(1,221,000)	(62,000)
Total operating expenses	(1,545,000)			(240,000)
Total assets	$ (314,628,000)	$ (143,804,000)	$ (129,339,000)	$ (314,628,000)	$ (185,109,000)