Note 6 - Loans (Details) - Summary of Impaired Loans by Loan Class (USD $) In Thousands, unless otherwise specified	Jun. 30, 2014	Dec. 31, 2013
Financing Receivable, Impaired [Line Items]
Recorded Investment	$ 30,384	$ 19,989
Unpaid Principal Balance	42,128	24,820
Related Allowance	0	0
Recorded Investment	5,072	22,152
Unpaid Principal Balance	5,202	23,378
Related Allowance	1,002	4,994
Subtotal:
Recorded Investment	35,456	42,141
Unpaid Principal Balance	47,330	48,198
Related Allowance	1,002	4,994
Commercial Portfolio Segment [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment	4,375
Unpaid Principal Balance	7,923
Related Allowance	0
Recorded Investment	13	6,590
Unpaid Principal Balance	13	6,808
Related Allowance	4	2,988
Subtotal:
Recorded Investment	4,388	6,590
Unpaid Principal Balance	7,936	6,808
Related Allowance	4	2,988
Commercial Real Estate Other Receivable [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment	16,830	15,736
Unpaid Principal Balance	21,817	18,184
Related Allowance	0	0
Recorded Investment	847	6,011
Unpaid Principal Balance	847	6,020
Related Allowance	208	814
Residential One To Four Family [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment	8,391	3,714
Unpaid Principal Balance	11,534	6,091
Related Allowance	0	0
Recorded Investment	3,623	8,805
Unpaid Principal Balance	3,753	9,804
Related Allowance	495	963
Residential Real Estate and Home Equities [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment	701	539
Unpaid Principal Balance	767	545
Related Allowance	0	0
Recorded Investment	589	746
Unpaid Principal Balance	589	746
Related Allowance	295	229
Consumer Portfolio Segment [Member]
Financing Receivable, Impaired [Line Items]
Recorded Investment	87
Unpaid Principal Balance	87
Subtotal:
Recorded Investment	87
Unpaid Principal Balance	87
Commercial Real Estate Portfolio Segment [Member]
Subtotal:
Recorded Investment	17,677	21,747
Unpaid Principal Balance	22,664	24,204
Related Allowance	208	814
Residential Portfolio Segment [Member]
Subtotal:
Recorded Investment	13,304	13,804
Unpaid Principal Balance	16,643	17,186
Related Allowance	$ 790	$ 1,192