Parent Company Financial Information (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2014	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Assets [Abstract]
Investment in wholly owned subsidiary	$ 719	$ 1,094
Total Assets	957,884	897,669
Liabilities and stockholders' equity [Abstract]
Stockholders' equity	92,051	84,908	92,325	87,702
Total Liabilities and Stockholders' Equity	957,884	897,669
Statements of Income [Abstract]
Income tax benefit	(2,790)	(2,854)	(1,723)
Net income	5,870	5,384	4,646
Statements of Cash Flows [Abstract]
Net income	5,870	5,384	4,646
Adjustments to reconcile net income to net cash provided by operating activities [Abstract]
Net cash (used in) provided by operating activities	10,442	16,220	14,334
Cash flows from financing activities [Abstract]
Dividend on preferred stock	(129)	(677)	(1,139)
Common stock issued and stock based compensation	84	76	93
Net cash provided by (used in) financing activities	53,214	62,371	43,804
Net increase in cash and cash equivalents	51,798	15,895	21,187
Cash and cash equivalents at beginning of year	177,254	161,359	140,172
Cash and cash equivalents at end of year	229,052	177,254	161,359
Parent Company [Member]
Assets [Abstract]
Cash	3,928	3,982
Investment in wholly owned subsidiary	88,155	81,070
Total Assets	92,083	85,052
Liabilities and stockholders' equity [Abstract]
Other liabilities	32	144
Stockholders' equity	92,051	84,908
Total Liabilities and Stockholders' Equity	92,083	85,052
Statements of Income [Abstract]
Dividends from subsidiary	0	10,000	0
Other operating expenses	(130)	(113)	(106)
Income tax benefit	54	46	44
(Loss) income before undistributed earnings of subsidiary	(76)	9,933	(62)
Equity in undistributed earnings of subsidiary	5,946	(4,549)	4,708
Net income	5,870	5,384	4,646
Statements of Cash Flows [Abstract]
Net income	5,870	5,384	4,646
Adjustments to reconcile net income to net cash provided by operating activities [Abstract]
Decrease in other liabilities	(112)	(141)	(54)
Equity in undistributed earnings of subsidiary	(5,946)	4,549	(4,708)
Net cash (used in) provided by operating activities	(188)	9,792	(116)
Cash flows from financing activities [Abstract]
Redemption of preferred stock	0	(10,000)	0
Dividend on preferred stock	(129)	(677)	(1,139)
Common stock issued and stock based compensation	269	233	208
Cash in lieu of fractional shares	(6)	(4)	(3)
Net cash provided by (used in) financing activities	134	(10,448)	(934)
Net increase in cash and cash equivalents	(54)	(656)	(1,050)
Cash and cash equivalents at beginning of year	3,982	4,638	5,688
Cash and cash equivalents at end of year	$ 3,928	$ 3,982	$ 4,638