Consolidated Statements of Cash Flows (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Cash flows from operating activities:
Net Income from continuing operations	$ 7,935	$ 7,560	$ 6,684
Adjustments to reconcile net income to net cash provided by operating activities:
Provision for loan losses	2,750	9,400	8,991
Provision for unfunded commitments	200	150	0
Provision for depreciation and amortization	993	874	833
Compensation expense associated with stock options	31	61	36
Gross proceeds from sales of loans held-for-sale, carried at cost	0	437,940	360,336
Gross originations of loans held-for-sale, carried at cost	0	(410,699)	(375,586)
Gain on sale of securities available-for-sale	(995)	(3,822)	(1,550)
Amortization of investment premiums and accretion of discounts, net	1,153	321	1,290
Amortization of held-to-maturity fair value adjustments	(155)	(65)	0
Loss on sale of other real estate owned	130	1,096	662
Write down of other real estate owned	0	425	557
Loss on sale of fixed assets	6	4	2
(Increase) decrease in deferred income tax (benefit) expense	(1,130)	(2,143)	729
(Increase) in cash surrender value of bank owned life policies	(709)	(5,384)	(772)
(Increase) decrease in other assets	(5,145)	(495)	3,547
(Decrease) increase in deferred compensation	(115)	566	518
Decrease (increase) in deferred loan fees	9	(275)	(127)
Increase in other liabilities	4,970	120	95
Decrease (increase) in assets from discontinued operations	0	16,453	(5,387)
(Decrease) increase in liabilities and equity from discontinued operations	0	(12,408)	5,387
Net cash provided by operating activities	9,928	39,679	6,245
Cash flows from investing activities:
Proceeds from maturities and payments of available-for-sale securities	12,059	24,907	36,776
Proceeds from sale of available-for-sale securities	103,303	112,149	104,276
Purchases of available-for-sale securities	(141,573)	(143,990)	(150,311)
Proceeds from maturities and payments of held-to-maturity securities	57	0	0
Purchases of held-to-maturity securities	(5,151)	(12,653)	0
Loan principal repayments, net of originations	64,790	(67,560)	(1,680)
Purchase of premises and equipment, net	(2,156)	(1,313)	(586)
Proceeds from the sale of other real estate owned	3,603	5,387	2,371
(Payments) proceeds from the termination of interest rate swaps	(503)	0	3,000
Proceeds from sale of mortgage subsidiary	0	321	0
Net cash provided by (used in) investing activities	34,429	(82,752)	(6,154)
Cash flows from financing activities:
Net increase in demand deposits and savings accounts	51,386	60,944	46,025
Net decrease in certificates of deposit	(6,145)	(28,196)	(29,296)
Net (decrease) increase in securities sold under agreements to repurchase	(13,095)	(684)	231
Advances on term debt	900,000	659,000	636,000
Repayment of term debt	(950,000)	(643,000)	(668,000)
Repurchase of common stock	(10,614)	(4,305)	0
Cash dividends paid on common stock	(2,111)	(1,988)	(2,039)
Cash dividends paid on preferred stock	(347)	(945)	(737)
Proceeds from stock options exercised	16	0	0
Net proceeds from the issuance of Series B, preferred stock	0	0	2,931
Repurchase of common stock warrants	0	0	(125)
Net cash provided by (used in) financing activities	(30,910)	40,826	(15,010)
Net (decrease) cash and cash equivalents	13,447	(2,247)	(14,919)
Cash and cash equivalents at beginning of year	45,068	47,315	62,234
Cash and cash equivalents at end of year	58,515	45,068	47,315
Cash paid during the period for:
Income taxes	7,859	5,563	3,366
Interest	3,523	6,368	8,698
Supplemental disclosures of non cash investing activities:
Transfer of loans to other real estate owned	1,585	6,238	5,033
Changes in unrealized (loss) gain on investment securities available-for-sale	(6,648)	1,586	4,767
Changes in net deferred tax asset related to changes in unrealized gain on investment securities	2,739	(653)	(1,962)
Changes in accumulated other comprehensive income due to changes in unrealized (loss) gain on investment securities	(3,909)	933	2,805
Changes in unrealized gain (loss) on derivatives	691	(2,489)	(938)
Changes in net deferred tax asset related to changes in unrealized loss on derivatives	(284)	1,024	387
Changes in accumulated other comprehensive income due to changes in unrealized gain (loss) on derivatives	407	(1,465)	(551)
Reclassification of earnings from gains on derivatives	(304)	(500)	0
Changes in net deferred tax asset related to reclassification of earnings from gains on derivatives	247	208	0
Changes in accumulated other comprehensive income due to reclassification of earnings from gain on derivatives	(57)	(292)	0
Reclassifications of fair value adjustment to investment securities held-to-maturities	0	839	0
Accretion of held-to-maturity from other comprehensive income to interest income	(155)	(65)	0
Changes in deferred tax related to accretion of held-to-maturity investment securities	64	27	0
Changes in deferred tax asset related to reclassification of fair value adjustment to investment securities held-to-maturity	0	(345)	0
Changes in accumulated other comprehensive income due to reclassification adjustment to investments held-to-maturity	(91)	456	0
Reclassification of securities available-for-sale to held-to-maturity	0	18,797	0
Supplemental disclosures on non cash financing activities:
Accretion of preferred stock, Series A	0	0	269
Redemption of preferred stock, Series A	0	0	(17,000)
Issuance of preferred stock, Series B	0	0	19,931
Cash dividend declared on common stock and payable after period-end	469	675
Common stock [Member]
Supplemental disclosures on non cash financing activities:
Cash dividend declared on common stock and payable after period-end	419	479	510
Preferred stock [Member]
Supplemental disclosures on non cash financing activities:
Cash dividend declared on common stock and payable after period-end	$ 50	$ 196	$ 261