Loans and Allowance for Loan Losses - Impaired Loans (Details) (USD $)	3 Months Ended
	Mar. 31, 2014	Mar. 31, 2013	Dec. 31, 2013
Impaired Loans
Impaired financing receivable collectively evaluated for impairment	$ 6,900,000		$ 6,200,000
Threshold for individual impairment evaluation	250,000
Impaired loans with a related allowance for loan losses, related allowance	690,000		557,000
Total impaired loans, recorded investment	20,388,000		24,526,000
Total impaired loans, unpaid principal balance	21,637,000		25,911,000
Total impaired loans, average recorded investment	21,971,000	33,974,000
Total impaired loans, interest income recognized	189,000	242,000
Allowance for loan losses	16,522,000		18,063,000	[1]
Outstanding balance of purchased impaired loans	89,856		90,741
Impaired financing receivables, Allowance for credit losses, collectively evaluated for impairment	2,300,000		2,100,000
Allowance for Purchased Impaired Loans Excess Credit Discount
Impaired Loans
Allowance for loan losses	2,580		3,567
Commercial
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	775,000		4,095,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	775,000		4,502,000
Impaired loans without a related allowance for loan losses, average recorded investment	1,691,000	4,440,000
Impaired loans without a related allowance for loan losses, interest income recognized	12,000	40,000
Impaired loans with a related allowance for loan losses, recorded investment	366,000		308,000
Impaired loans with a related allowance for loan losses, unpaid principal balance	366,000		313,000
Impaired loans with a related allowance for loan losses, related allowance	366,000		105,000
Impaired loans with a related allowance for loan losses, average recorded investment	352,000	1,193,000
Impaired loans with a related allowance for loan losses, interest income recognized	0	0
Total impaired loans, recorded investment	1,141,000		4,403,000
Total impaired loans, unpaid principal balance	1,141,000		4,815,000
Total impaired loans, average recorded investment	2,043,000	5,633,000
Total impaired loans, interest income recognized	12,000	40,000
Consumer and other
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	0		0
Impaired loans without a related allowance for loan losses, unpaid principal balance	0		0
Impaired loans without a related allowance for loan losses, average recorded investment	0	0
Impaired loans without a related allowance for loan losses, interest income recognized	0	0
Impaired loans with a related allowance for loan losses, recorded investment	0		0
Impaired loans with a related allowance for loan losses, unpaid principal balance	0		0
Impaired loans with a related allowance for loan losses, related allowance	0		0
Impaired loans with a related allowance for loan losses, average recorded investment	0	0
Impaired loans with a related allowance for loan losses, interest income recognized	0	0
Total impaired loans, recorded investment	0		0
Total impaired loans, unpaid principal balance	0		0
Total impaired loans, average recorded investment	0	0
Total impaired loans, interest income recognized	0	0
Construction Loans
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	3,041,000		2,816,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	3,447,000		2,997,000
Impaired loans without a related allowance for loan losses, average recorded investment	3,806,000	5,976,000
Impaired loans without a related allowance for loan losses, interest income recognized	27,000	24,000
Impaired loans with a related allowance for loan losses, recorded investment	0		200,000
Impaired loans with a related allowance for loan losses, unpaid principal balance	0		215,000
Impaired loans with a related allowance for loan losses, related allowance	0		40,000
Impaired loans with a related allowance for loan losses, average recorded investment	50,000	2,634,000
Impaired loans with a related allowance for loan losses, interest income recognized	0	21,000
Total impaired loans, recorded investment	3,041,000		3,016,000
Total impaired loans, unpaid principal balance	3,447,000		3,212,000
Total impaired loans, average recorded investment	3,856,000	8,610,000
Total impaired loans, interest income recognized	27,000	45,000
Owner Occupied
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	8,437,000		5,445,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	9,047,000		5,981,000
Impaired loans without a related allowance for loan losses, average recorded investment	7,184,000	3,300,000
Impaired loans without a related allowance for loan losses, interest income recognized	70,000	25,000
Impaired loans with a related allowance for loan losses, recorded investment	4,996,000		5,131,000
Impaired loans with a related allowance for loan losses, unpaid principal balance	4,996,000		5,172,000
Impaired loans with a related allowance for loan losses, related allowance	127,000		201,000
Impaired loans with a related allowance for loan losses, average recorded investment	5,038,000	7,705,000
Impaired loans with a related allowance for loan losses, interest income recognized	61,000	58,000
Total impaired loans, recorded investment	13,433,000		10,576,000
Total impaired loans, unpaid principal balance	14,043,000		11,153,000
Total impaired loans, average recorded investment	12,222,000	11,005,000
Total impaired loans, interest income recognized	131,000	83,000
Non-owner Occupied
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	1,186,000		4,469,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	1,294,000		4,537,000
Impaired loans without a related allowance for loan losses, average recorded investment	2,031,000	5,573,000
Impaired loans without a related allowance for loan losses, interest income recognized	4,000	60,000
Impaired loans with a related allowance for loan losses, recorded investment	644,000		645,000
Impaired loans with a related allowance for loan losses, unpaid principal balance	644,000		645,000
Impaired loans with a related allowance for loan losses, related allowance	41,000		50,000
Impaired loans with a related allowance for loan losses, average recorded investment	644,000	497,000
Impaired loans with a related allowance for loan losses, interest income recognized	8,000	2,000
Total impaired loans, recorded investment	1,830,000		5,114,000
Total impaired loans, unpaid principal balance	1,938,000		5,182,000
Total impaired loans, average recorded investment	2,675,000	6,070,000
Total impaired loans, interest income recognized	12,000	62,000
One to Four Family
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	617,000		661,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	727,000		731,000
Impaired loans without a related allowance for loan losses, average recorded investment	665,000	730,000
Impaired loans without a related allowance for loan losses, interest income recognized	7,000	7,000
Impaired loans with a related allowance for loan losses, recorded investment	326,000		331,000
Impaired loans with a related allowance for loan losses, unpaid principal balance	341,000		341,000
Impaired loans with a related allowance for loan losses, related allowance	156,000		161,000
Impaired loans with a related allowance for loan losses, average recorded investment	329,000	448,000
Impaired loans with a related allowance for loan losses, interest income recognized	0	3,000
Total impaired loans, recorded investment	943,000		992,000
Total impaired loans, unpaid principal balance	1,068,000		1,072,000
Total impaired loans, average recorded investment	994,000	1,178,000
Total impaired loans, interest income recognized	7,000	10,000
Multifamily
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	0		0
Impaired loans without a related allowance for loan losses, unpaid principal balance	0		0
Impaired loans without a related allowance for loan losses, average recorded investment	65,000	260,000
Impaired loans without a related allowance for loan losses, interest income recognized	0	0
Impaired loans with a related allowance for loan losses, recorded investment	0		0
Impaired loans with a related allowance for loan losses, unpaid principal balance	0		0
Impaired loans with a related allowance for loan losses, related allowance	0		0
Impaired loans with a related allowance for loan losses, average recorded investment	0	0
Impaired loans with a related allowance for loan losses, interest income recognized	0	0
Total impaired loans, recorded investment	0		0
Total impaired loans, unpaid principal balance	0		0
Total impaired loans, average recorded investment	65,000	260,000
Total impaired loans, interest income recognized	0	0
Home Equity Lines of Credit
Impaired Loans
Impaired loans without a related allowance for loan losses, recorded investment	0		425,000
Impaired loans without a related allowance for loan losses, unpaid principal balance	0		477,000
Impaired loans without a related allowance for loan losses, average recorded investment	116,000	473,000
Impaired loans without a related allowance for loan losses, interest income recognized	0	0
Impaired loans with a related allowance for loan losses, recorded investment	0		0
Impaired loans with a related allowance for loan losses, unpaid principal balance	0		0
Impaired loans with a related allowance for loan losses, related allowance	0		0
Impaired loans with a related allowance for loan losses, average recorded investment	0	745,000
Impaired loans with a related allowance for loan losses, interest income recognized	0	2,000
Total impaired loans, recorded investment	0		425,000
Total impaired loans, unpaid principal balance	0		477,000
Total impaired loans, average recorded investment	116,000	1,218,000
Total impaired loans, interest income recognized	$ 0	$ 2,000

[1] Derived from audited consolidated financial statements