Consolidated Statements of Cash Flows (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2014	Dec. 31, 2013	Dec. 31, 2012
Cash flows from operating activities:
Net income from continuing operations	$ 5,727	$ 7,935	$ 7,560
Adjustments to reconcile net income to net cash provided by operating activities:
Provision for loan and lease losses	3,175	2,750	9,400
Provision for unfunded commitments		200	150
Provision for depreciation and amortization	1,320	993	874
Compensation expense associated with stock options	60	31	61
Gross proceeds from sales of loans held-for-sale, carried at cost			437,940
Gross originations of loans held-for-sale, carried at cost			(410,699)
Net loss (gain) on sale of securities available-for-sale	159	(995)	(3,822)
Amortization of investment premiums and accretion of discounts, net	1,662	1,153	321
Amortization of held-to-maturity fair value adjustments	(155)	(155)	(65)
Loss on sale of other real estate owned	8	130	1,096
Write down of other real estate owned	290		425
Gain on sale of fixed assets	7	6	4
(Gain) on repayment of junior subordinated debentures	(406)
(Increase) in deferred income taxes	(191)	(1,130)	(2,143)
(Increase) in cash surrender value of life insurance	(628)	(709)	(384)
(Increase) decrease in other assets	(946)	(5,145)	(495)
Increase (decrease) in deferred compensation	1,388	(115)	566
Decrease (increase) in deferred loan fees	146	9	(275)
Increase in other liabilities	2,398	4,970	120
Decrease in assets from discontinued operations			16,453
Decrease in liabilities and equity from discontinued operations			(12,408)
Net cash provided by operating activities	14,014	9,928	44,679
Cash flows from investing activities:
Proceeds from maturities and payments of available-for-sale securities	20,248	12,059	24,907
Proceeds from sale of available-for-sale securities	93,545	103,303	112,149
Purchases of available-for-sale securities	(79,852)	(141,573)	(143,990)
Proceeds from maturities and payments of held-to-maturity securities	311	57
Purchases of held-to-maturity securities	(244)	(5,151)	(12,653)
Loan (originations), net of principal repayments	(9,449)	64,790	(67,560)
Purchase of loan pools	(60,670)
Cash paid for low income housing investments	(2,371)
Net purchase of Federal Home Loan Bank of San Francisco stock	(1,198)
Purchase of premises and equipment, net	(2,729)	(2,156)	(1,313)
Proceeds from the sale of other real estate owned	802	3,603	5,387
Proceeds from settlement of note to former mortgage subsidiary	686
Purchase of life insurance	(5,000)		(5,000)
Payments to derivative counterparties for the termination of interest rate swaps		(503)
Proceeds from sale of mortgage subsidiary			321
Net cash (used in) provided by investing activities	(45,921)	34,429	(87,752)
Cash flows from financing activities:
Net increase in demand deposits and savings accounts	46,470	51,386	60,944
Net (decrease) in certificates of deposit	(3,728)	(6,145)	(28,196)
Net decrease in securities sold under agreements to repurchase		(13,095)	(684)
Advances on term debt	250,000	900,000	659,000
Repayment of term debt	(250,000)	(950,000)	(643,000)
Repayment of subordinated debentures	(4,629)
Repurchase of common stock	(4,562)	(10,614)	(4,305)
Cash dividends paid on common stock	(1,626)	(2,111)	(1,988)
Cash dividends paid on preferred stock	(200)	(347)	(945)
Proceeds from stock options exercised	23	16
Stock issued under employee and director stock purchase plan	66
Net cash provided by (used in) financing activities	31,814	(30,910)	40,826
Net (decrease) increase cash and cash equivalents	(93)	13,447	(2,247)
Cash and cash equivalents at beginning of year	58,515	45,068	47,315
Cash and cash equivalents at end of year	58,422	58,515	45,068
Supplemental disclosures of cash flow activity:
Income taxes	419	7,859	5,563
Interest	4,192	4,123	6,868
Supplemental disclosures of non cash investing activities:
Transfer of loans to other real estate owned	689	1,585	6,238
Changes in unrealized gain on investment securities available-for-sale	6,307	(6,648)	1,586
Changes in net deferred tax asset related to changes in unrealized gain on investment securities	(2,596)	2,739	(653)
Changes in accumulated other comprehensive income due to changes in unrealized (loss) gain on investment securities	3,711	(3,909)	933
Changes in unrealized (gain) loss on derivatives	(333)	691	(2,489)
Changes in net deferred tax asset related to changes in unrealized loss on derivatives	136	(284)	1,024
Changes in accumulated other comprehensive income due to changes in unrealized gain (loss) on derivatives	(197)	407	(1,465)
Reclassification of earnings from gains on derivatives	(1,900)	(304)	(500)
Changes in net deferred tax asset related to reclassification of earnings from gains on derivatives	782	247	208
Changes in accumulated other comprehensive income due to reclassification of earnings from gain on derivatives	(1,118)	(57)	(292)
Reclassification of fair value adjustment to investment securities held-to-maturity			839
Accretion of held-to-maturity from other comprehensive income to interest income	(155)	(155)	(65)
Changes in deferred tax related to accretion of held-to-maturity investment securities	64	64	27
Changes in deferred tax asset related to reclassification of fair value adjustment to investment securities held-to-maturity			(345)
Changes in accumulated other comprehensive income due to reclassification adjustment to investments held-to-maturity	(91)	(91)	456
Reclassification of securities available-for-sale to held-to-maturity			18,797
Supplemental disclosures of non cash financing activities:
Dividend payable	449	469
Common Stock [Member]
Supplemental disclosures of non cash financing activities:
Dividend payable	399	419	479
Preferred Stock [Member]
Supplemental disclosures of non cash financing activities:
Dividend payable	$ 50	$ 50	$ 196