Loans, Net Recorded investment in nonaccrual loans and loans past due and still accruing by class of loans (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2014	Dec. 31, 2013
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	$ 7,332	$ 19,752
Past due 90 days or more and still accruing	30	808
Real Estate Loans Construction [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	258	2,368
Past due 90 days or more and still accruing	0	268
Real Estate Loans Secured by 1 - 4 family residential [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	5,265	9,458
Past due 90 days or more and still accruing	0	539
Other real estate loans [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	1,507	6,045
Past due 90 days or more and still accruing	0	0
Commercial loans [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	299	1,844
Past due 90 days or more and still accruing	30	0
Consumer loans [Member]
Financing Receivable, Recorded Investment, Past Due [Line Items]
Nonaccrual	3	37
Past due 90 days or more and still accruing	$ 0	$ 1