Loans and Allowance for Loan Losses - Nonaccrual and Past Due Loans (Details) (USD $) In Thousands, unless otherwise specified	Mar. 31, 2014 Loans	Dec. 31, 2013 Loans
Financing Receivable, Recorded Investment, Past Due
Financing Receivable, Recorded Investment, 90 Days Past Due and Still Accruing	$ 0	$ 0
Financing receivables on nonaccrual status	15,081	15,393
Loans and Leases Receivable, Ratio of Nonperforming Loans to All Loans	1.09%	1.12%
Total number of loans on nonaccrual status	187	195
Past due Loans, Aging Analysis
30 to 59 Days Past Due	9,773	9,998
60 to 89 Days Past Due	6,746	2,920
Greater Than 90 Days	3,525	2,486
Total Past Due	20,044	15,404
Current	1,361,512	1,342,363
Loans	1,381,556	1,357,767
Commercial
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	1,245	2,306
Past due Loans, Aging Analysis
30 to 59 Days Past Due	1,221	2,029
60 to 89 Days Past Due	379	742
Greater Than 90 Days	612	142
Total Past Due	2,212	2,913
Current	181,613	182,530
Loans	183,825	185,443
Consumer and other
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	272	258
Past due Loans, Aging Analysis
30 to 59 Days Past Due	203	322
60 to 89 Days Past Due	7	62
Greater Than 90 Days	40	52
Total Past Due	250	436
Current	44,437	51,231
Loans	44,687	51,667
Construction Loans
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	2,181	2,331
Past due Loans, Aging Analysis
30 to 59 Days Past Due	260	855
60 to 89 Days Past Due	735	207
Greater Than 90 Days	790	541
Total Past Due	1,785	1,603
Current	123,161	129,432
Loans	124,946	131,035
Owner Occupied
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	6,172	4,417
Past due Loans, Aging Analysis
30 to 59 Days Past Due	3,715	1,973
60 to 89 Days Past Due	3,166	0
Greater Than 90 Days	571	58
Total Past Due	7,452	2,031
Current	382,435	380,735
Loans	389,887	382,766
Non-owner Occupied
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	1,619	1,806
Past due Loans, Aging Analysis
30 to 59 Days Past Due	783	1,172
60 to 89 Days Past Due	836	129
Greater Than 90 Days	518	432
Total Past Due	2,137	1,733
Current	200,835	195,193
Loans	202,972	196,926
One to Four Family
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	2,682	2,734
Past due Loans, Aging Analysis
30 to 59 Days Past Due	3,247	2,738
60 to 89 Days Past Due	1,470	1,190
Greater Than 90 Days	994	1,186
Total Past Due	5,711	5,114
Current	174,395	168,958
Loans	180,106	174,072
Multifamily
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	6	256
Past due Loans, Aging Analysis
30 to 59 Days Past Due	0	0
60 to 89 Days Past Due	0	249
Greater Than 90 Days	0	0
Total Past Due	0	249
Current	62,332	41,464
Loans	62,332	41,713
Home Equity Lines of Credit
Financing Receivable, Recorded Investment, Past Due
Financing receivables on nonaccrual status	904	1,285
Past due Loans, Aging Analysis
30 to 59 Days Past Due	344	909
60 to 89 Days Past Due	153	341
Greater Than 90 Days	0	75
Total Past Due	497	1,325
Current	192,304	192,820
Loans	$ 192,801	$ 194,145