Aging Analysis of Loans (Details) - USD ($) $ in Thousands	Jun. 30, 2017	Dec. 31, 2016
Financing Receivable Recorded Investment Past Due [Line Items]
Current	$ 738,119	$ 640,847
Total past due	742,347	651,642
Nonaccrual loans	7,706	7,722
Financing Receivables, 30 to 59 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due	66	6,163
Financing Receivables, 60 to 89 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due	386	557
Financing Receivables, Over 90 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due	3,776	4,075
1-4 Family Investor Owned
Financing Receivable Recorded Investment Past Due [Line Items]
Current	256,524	224,368
Total past due	256,989	227,409
Nonaccrual loans	1,761	2,048
1-4 Family Investor Owned | Financing Receivables, 30 to 59 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due		2,716
1-4 Family Investor Owned | Financing Receivables, 60 to 89 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due	140
1-4 Family Investor Owned | Financing Receivables, Over 90 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due	325	325
Multifamily
Financing Receivable Recorded Investment Past Due [Line Items]
Current	172,167	157,381
Total past due	172,167	158,200
Multifamily | Financing Receivables, 30 to 59 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due		819
1-4 Family Owner Occupied
Financing Receivable Recorded Investment Past Due [Line Items]
Current	97,357	92,778
Total past due	99,901	97,631
Nonaccrual loans	3,273	2,110
1-4 Family Owner Occupied | Financing Receivables, 30 to 59 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due		2,562
1-4 Family Owner Occupied | Financing Receivables, 60 to 89 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due	246	557
1-4 Family Owner Occupied | Financing Receivables, Over 90 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due	2,298	1,734
Nonresidential Properties
Financing Receivable Recorded Investment Past Due [Line Items]
Current	154,529	119,465
Total past due	155,670	121,500
Nonaccrual loans	1,652	2,397
Nonresidential Properties | Financing Receivables, 30 to 59 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due		41
Nonresidential Properties | Financing Receivables, Over 90 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due	1,141	1,994
Construction and Land
Financing Receivable Recorded Investment Past Due [Line Items]
Current	42,116	30,340
Total past due	42,116	30,340
Nonaccrual loans	1,008	1,145
Business
Financing Receivable Recorded Investment Past Due [Line Items]
Current	14,576	15,672
Total past due	14,654	15,719
Nonaccrual loans	12	22
Business | Financing Receivables, 30 to 59 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due	66	25
Business | Financing Receivables, Over 90 Days Past Due
Financing Receivable Recorded Investment Past Due [Line Items]
Total past due	12	22
Consumer
Financing Receivable Recorded Investment Past Due [Line Items]
Current	850	843
Total past due	$ 850	$ 843