Impaired Loans and Valuation Allowance for Loan Losses (Details 5) (USD $) In Thousands, unless otherwise specified	Jun. 30, 2012	Jun. 30, 2011
Loan portfolio and related allowance
Individually Evaluated for Impairment, carrying value	$ 103,324	$ 106,403
Collectively Evaluated for Impairment, carrying value	1,118,030	1,082,542
Allowance for Credit Losses, Individually Evaluated for Impairment	9,273	11,582
Allowance for Credit Losses, Collectively Evaluated for Impairment	15,362	19,649
Financing Receivable, Carrying Value, Total	1,221,354	1,188,945
Financing Receivable Allowances, Total	24,635	31,231
Construction and land development [Member]
Loan portfolio and related allowance
Individually Evaluated for Impairment, carrying value	4,871	5,738
Collectively Evaluated for Impairment, carrying value	52,357	43,455
Allowance for Credit Losses, Individually Evaluated for Impairment	449	464
Allowance for Credit Losses, Collectively Evaluated for Impairment	906	1,567
Financing Receivable, Carrying Value, Total	57,228	49,193
Financing Receivable Allowances, Total	1,355	2,031
Commercial real estate [Member]
Loan portfolio and related allowance
Individually Evaluated for Impairment, carrying value	55,178	64,245
Collectively Evaluated for Impairment, carrying value	438,438	452,690
Allowance for Credit Losses, Individually Evaluated for Impairment	4,615	7,316
Allowance for Credit Losses, Collectively Evaluated for Impairment	7,362	8,935
Financing Receivable, Carrying Value, Total	493,616	516,935
Financing Receivable Allowances, Total	11,977	16,251
Residential real estate [Member]
Loan portfolio and related allowance
Individually Evaluated for Impairment, carrying value	42,219	35,218
Collectively Evaluated for Impairment, carrying value	521,716	487,844
Allowance for Credit Losses, Individually Evaluated for Impairment	4,099	3,690
Allowance for Credit Losses, Collectively Evaluated for Impairment	6,213	7,685
Financing Receivable, Carrying Value, Total	563,935	523,062
Financing Receivable Allowances, Total	10,312	11,375
Commercial and financial [Member]
Loan portfolio and related allowance
Individually Evaluated for Impairment, carrying value	40	111
Collectively Evaluated for Impairment, carrying value	56,180	47,901
Allowance for Credit Losses, Individually Evaluated for Impairment	1	10
Allowance for Credit Losses, Collectively Evaluated for Impairment	328	562
Financing Receivable, Carrying Value, Total	56,220	48,012
Financing Receivable Allowances, Total	329	572
Consumer [Member]
Loan portfolio and related allowance
Individually Evaluated for Impairment, carrying value	1,016	1,091
Collectively Evaluated for Impairment, carrying value	49,339	50,652
Allowance for Credit Losses, Individually Evaluated for Impairment	109	102
Allowance for Credit Losses, Collectively Evaluated for Impairment	553	900
Financing Receivable, Carrying Value, Total	50,355	51,743
Financing Receivable Allowances, Total	$ 662	$ 1,002