Note 9 - Business Segments (Details) - Segment Reporting (USD $) In Thousands, unless otherwise specified	3 Months Ended		6 Months Ended
	Jun. 30, 2014	Jun. 30, 2013	Jun. 30, 2014	Jun. 30, 2013	Dec. 31, 2013
Revenues:
Interest income	$ 21,712	$ 19,230	$ 43,006	$ 38,353
Gains on sales of loans	1,647	3,577	2,837	5,278
Other noninterest income	3,619	3,386	7,241	6,783
Total operating income	26,978	26,193	53,084	50,414
Expenses:
Interest expense	2,141	2,082	4,361	4,230
Provision for loan losses	3,265	3,120	6,775	6,300
Salaries and employee benefits	9,065	8,229	18,224	15,298
Other noninterest expenses	7,191	6,319	14,386	12,279
Total operating expenses	21,662	19,750	43,746	38,107
Income (loss) before income taxes	5,316	6,443	9,338	12,307
Provision for (benefit from) income taxes	1,574	2,265	2,703	4,123
Net income (loss)	3,742	4,178	6,635	8,184
Total assets	1,347,491	992,681	1,347,491	992,681	1,312,297
Goodwill	16,630	10,723	16,630	10,723	16,630
Capital expenditures	766	579	1,274	1,906
Intersegment Eliminations [Member]
Revenues:
Interest income	(1,224)	(1,290)	(2,434)	(2,582)
Total operating income	(1,224)	(1,290)	(2,434)	(2,582)
Expenses:
Interest expense	(1,224)	(1,290)	(2,434)	(2,582)
Total operating expenses	(1,224)	(1,290)	(2,434)	(2,582)
Total assets	(174,261)	(217,252)	(174,261)	(217,252)
Retail Banking [Member]
Revenues:
Interest income	10,919	7,783	21,687	15,599
Other noninterest income	2,283	1,689	4,508	3,400
Total operating income	13,202	9,472	26,195	18,999
Expenses:
Interest expense	1,495	1,473	3,070	3,017
Provision for loan losses		600		1,000
Salaries and employee benefits	5,589	4,067	11,439	8,209
Other noninterest expenses	4,621	3,228	9,299	6,253
Total operating expenses	11,705	9,368	23,808	18,479
Income (loss) before income taxes	1,497	104	2,387	520
Provision for (benefit from) income taxes	76	(395)	(19)	(675)
Net income (loss)	1,421	499	2,406	1,195
Total assets	1,184,486	843,917	1,184,486	843,917
Goodwill	5,907		5,907
Capital expenditures	680	527	1,148	1,732
Mortgage Banking [Member]
Revenues:
Interest income	333	416	631	843
Gains on sales of loans	1,647	3,577	2,837	5,278
Other noninterest income	733	1,086	1,488	2,164
Total operating income	2,713	5,079	4,956	8,285
Expenses:
Interest expense	50	81	94	173
Provision for loan losses	15	30	30	60
Salaries and employee benefits	1,138	2,009	2,099	2,754
Other noninterest expenses	1,136	1,315	2,334	2,744
Total operating expenses	2,339	3,435	4,557	5,731
Income (loss) before income taxes	374	1,644	399	2,554
Provision for (benefit from) income taxes	150	658	160	1,022
Net income (loss)	224	986	239	1,532
Total assets	48,755	75,448	48,755	75,448
Capital expenditures	7	30	41	131
Consumer Finance [Member]
Revenues:
Interest income	11,684	12,320	23,122	24,492
Other noninterest income	261	276	562	574
Total operating income	11,945	12,596	23,684	25,066
Expenses:
Interest expense	1,585	1,628	3,159	3,244
Provision for loan losses	3,250	2,490	6,745	5,240
Salaries and employee benefits	2,107	1,944	4,254	3,934
Other noninterest expenses	1,218	1,060	2,302	2,174
Total operating expenses	8,160	7,122	16,460	14,592
Income (loss) before income taxes	3,785	5,474	7,224	10,474
Provision for (benefit from) income taxes	1,476	2,135	2,817	4,085
Net income (loss)	2,309	3,339	4,407	6,389
Total assets	284,905	286,514	284,905	286,514
Goodwill	10,723	10,723	10,723	10,723
Capital expenditures	79	22	84	41
Other Segments [Member]
Revenues:
Interest income		1		1
Other noninterest income	342	335	683	645
Total operating income	342	336	683	646
Expenses:
Interest expense	235	190	472	378
Salaries and employee benefits	231	209	432	401
Other noninterest expenses	216	716	451	1,108
Total operating expenses	682	1,115	1,355	1,887
Income (loss) before income taxes	(340)	(779)	(672)	(1,241)
Provision for (benefit from) income taxes	(128)	(133)	(255)	(309)
Net income (loss)	(212)	(646)	(417)	(932)
Total assets	3,606	4,054	3,606	4,054
Capital expenditures			$ 1	$ 2