Loans and Allowance for Loan Losses - Nonaccrual and Past Due Loans (Details) (USD $)	Jun. 30, 2014 Loans	Dec. 31, 2013 Loans
Financing Receivable, Recorded Investment, Past Due
Financing Receivable, Recorded Investment, 90 Days Past Due and Still Accruing	$ 0	$ 0
Financing receivables on nonaccrual status	18,982,000	15,393,000
Loans and Leases Receivable, Ratio of Nonperforming Loans to All Loans	1.32%	1.12%
Total number of loans on nonaccrual status	202	195
Past due Loans, Aging Analysis
30 to 59 Days Past Due	5,165,000	9,998,000
60 to 89 Days Past Due	1,608,000	2,920,000
Greater Than 90 Days	10,650,000	2,486,000
Total Past Due	17,423,000	15,404,000
Current	1,401,321,000	1,342,363,000
Loans	1,418,744,000	1,357,767,000
Commercial
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	2,787,000	2,306,000
Past due Loans, Aging Analysis
30 to 59 Days Past Due	484,000	2,029,000
60 to 89 Days Past Due	1,153,000	742,000
Greater Than 90 Days	2,092,000	142,000
Total Past Due	3,729,000	2,913,000
Current	180,709,000	182,530,000
Loans	184,438,000	185,443,000
Consumer and other
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	254,000	258,000
Past due Loans, Aging Analysis
30 to 59 Days Past Due	151,000	322,000
60 to 89 Days Past Due	58,000	62,000
Greater Than 90 Days	37,000	52,000
Total Past Due	246,000	436,000
Current	45,729,000	51,231,000
Loans	45,975,000	51,667,000
Construction Loans
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	2,205,000	2,331,000
Past due Loans, Aging Analysis
30 to 59 Days Past Due	1,271,000	855,000
60 to 89 Days Past Due	0	207,000
Greater Than 90 Days	847,000	541,000
Total Past Due	2,118,000	1,603,000
Current	125,435,000	129,432,000
Loans	127,553,000	131,035,000
Owner Occupied
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	6,403,000	4,417,000
Past due Loans, Aging Analysis
30 to 59 Days Past Due	1,080,000	1,973,000
60 to 89 Days Past Due	77,000	0
Greater Than 90 Days	3,507,000	58,000
Total Past Due	4,664,000	2,031,000
Current	412,676,000	380,735,000
Loans	417,340,000	382,766,000
Non-owner Occupied
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	1,740,000	1,806,000
Past due Loans, Aging Analysis
30 to 59 Days Past Due	681,000	1,172,000
60 to 89 Days Past Due	0	129,000
Greater Than 90 Days	863,000	432,000
Total Past Due	1,544,000	1,733,000
Current	201,706,000	195,193,000
Loans	203,250,000	196,926,000
One to Four Family
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	4,576,000	2,734,000
Past due Loans, Aging Analysis
30 to 59 Days Past Due	975,000	2,738,000
60 to 89 Days Past Due	224,000	1,190,000
Greater Than 90 Days	3,144,000	1,186,000
Total Past Due	4,343,000	5,114,000
Current	173,945,000	168,958,000
Loans	178,288,000	174,072,000
Multifamily
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	6,000	256,000
Past due Loans, Aging Analysis
30 to 59 Days Past Due	0	0
60 to 89 Days Past Due	0	249,000
Greater Than 90 Days	0	0
Total Past Due	0	249,000
Current	64,805,000	41,464,000
Loans	64,805,000	41,713,000
Home Equity Lines of Credit
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	1,011,000	1,285,000
Past due Loans, Aging Analysis
30 to 59 Days Past Due	523,000	909,000
60 to 89 Days Past Due	96,000	341,000
Greater Than 90 Days	160,000	75,000
Total Past Due	779,000	1,325,000
Current	196,316,000	192,820,000
Loans	$ 197,095,000	$ 194,145,000