Note 25 - Quarterly Financial Data (Unaudited) (Details) - Selected Quarterly Financial Data Regarding Results of Operations (USD $) In Thousands, except Per Share data, unless otherwise specified	3 Months Ended								12 Months Ended
	Dec. 31, 2013	Sep. 30, 2013	Jun. 30, 2013	Mar. 31, 2013	Dec. 31, 2012	Sep. 30, 2012	Jun. 30, 2012	Mar. 31, 2012	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Selected Quarterly Financial Data Regarding Results of Operations [Abstract]
Interest income	$ 10,423	$ 10,523	$ 10,728	$ 10,864	$ 10,867	$ 11,076	$ 11,422	$ 12,025	$ 42,538	$ 45,390	$ 51,818
Interest expense	387	475	503	895	1,178	1,227	1,339	1,394	2,260	5,138	9,426
Net interest income	10,036	10,048	10,225	9,969	9,689	9,849	10,083	10,631	40,278	40,252	42,392
Provision for loan losses	1,800	645	670	350	1,325	600	8,450	2,700	3,465	13,075	20,500
Net interest income after provision for loan losses	8,236	9,403	9,555	9,619	8,364	9,249	1,633	7,931	36,813	27,177	21,892
Investment securities gains (losses), net	23	(44)	331		635		9,859		310	10,494	157
Other noninterest income	3,552	3,323	3,906	3,745	4,167	4,335	4,104	3,930	14,526	16,536
Noninterest expense	10,212	9,835	11,911	10,375	11,327	10,858	19,234	11,931	42,333	53,350	63,382
Net income before provision (benefit) for income taxes	1,599	2,847	1,881	2,989	1,839	2,726	(3,638)	(70)	9,316	857	(26,064)
Provision (benefit) for income taxes	(224)	(19,386)	382	813	(871)	(436)	3,511	517	(18,415)	2,721	(2,664)
Net income	$ 1,823	$ 22,233	$ 1,499	$ 2,176	$ 2,710	$ 3,162	$ (7,149)	$ (587)	$ 27,731	$ (1,864)	$ (23,400)
Common and per share data
Net income - basic (in Dollars per share)	$ 0.14	$ 1.74	$ 0.12	$ 0.17	$ 0.21	$ 0.25	$ (0.57)	$ (0.05)	$ 2.17	$ (0.15)	$ (1.86)
Net income - diluted (in Dollars per share)	$ 0.14	$ 1.74	$ 0.12	$ 0.17	$ 0.21	$ 0.25	$ (0.57)	$ (0.05)	$ 2.17	$ (0.15)	$ (1.86)