Investment Securities - Summary of Individual Securities in Continuous Unrealized Loss Position (Details)	6 Months Ended
	Jun. 30, 2020 USD ($) security	Jun. 30, 2019 USD ($)	Dec. 31, 2019 USD ($) security
Securities available-for-sale:
Less Than 12 Months, Fair Value	$ 8,994,000		$ 25,580,000
Less Than 12 Months, Gross Unrealized Losses	$ (48,000)		$ (118,000)
Less Than 12 Months, Number of Securities | security	10		23
12 months or Longer, Fair Value	$ 15,735,000		$ 37,914,000
12 months or Longer, Gross Unrealized Losses	$ (115,000)		$ (351,000)
12 months or Longer, Number of Securities | security	13		50
Total, Fair Value	$ 24,729,000		$ 63,494,000
Total, Gross Unrealized Losses	$ (163,000)		$ (469,000)
Total, Number of Securities | security	23		73
Securities held-to-maturity:
Less Than 12 Months, Fair Value			$ 0
Less Than 12 Months, Gross Unrealized Losses			$ 0
Less Than 12 Months, Number of Securities | security			0
12 Months or Longer, Fair Value			$ 6,842,000
12 Months or Longer, Gross Unrealized Losses			$ (81,000)
12 Months or Longer, Number of Securities | security			7
Total, Fair Value			$ 6,842,000
Total, Gross Unrealized Losses			$ (81,000)
Total, Number of Securities | security			7
OTTI Assessment	$ 0	$ 0
Residential mortgage-backed securities
Securities available-for-sale:
Less Than 12 Months, Fair Value	4,742,000		$ 5,401,000
Less Than 12 Months, Gross Unrealized Losses	$ (37,000)		$ (28,000)
Less Than 12 Months, Number of Securities | security	3		5
12 months or Longer, Fair Value	$ 0		$ 15,772,000
12 months or Longer, Gross Unrealized Losses	$ 0		$ (123,000)
12 months or Longer, Number of Securities | security	0		23
Total, Fair Value	$ 4,742,000		$ 21,173,000
Total, Gross Unrealized Losses	$ (37,000)		$ (151,000)
Total, Number of Securities | security	3		28
Securities held-to-maturity:
Less Than 12 Months, Fair Value			$ 0
Less Than 12 Months, Gross Unrealized Losses			$ 0
Less Than 12 Months, Number of Securities | security			0
12 Months or Longer, Fair Value			$ 6,842,000
12 Months or Longer, Gross Unrealized Losses			$ (81,000)
12 Months or Longer, Number of Securities | security			7
Total, Fair Value			$ 6,842,000
Total, Gross Unrealized Losses			$ (81,000)
Total, Number of Securities | security			7
Residential collateralized mortgage obligations
Securities available-for-sale:
Less Than 12 Months, Fair Value	$ 2,088,000		$ 15,392,000
Less Than 12 Months, Gross Unrealized Losses	$ (6,000)		$ (52,000)
Less Than 12 Months, Number of Securities | security	4		13
12 months or Longer, Fair Value	$ 13,985,000		$ 19,834,000
12 months or Longer, Gross Unrealized Losses	$ (97,000)		$ (205,000)
12 months or Longer, Number of Securities | security	10		23
Total, Fair Value	$ 16,073,000		$ 35,226,000
Total, Gross Unrealized Losses	$ (103,000)		$ (257,000)
Total, Number of Securities | security	14		36
SBA loan pool securities
Securities available-for-sale:
Less Than 12 Months, Fair Value	$ 2,164,000		$ 4,787,000
Less Than 12 Months, Gross Unrealized Losses	$ (5,000)		$ (38,000)
Less Than 12 Months, Number of Securities | security	3		5
12 months or Longer, Fair Value	$ 1,750,000		$ 2,308,000
12 months or Longer, Gross Unrealized Losses	$ (18,000)		$ (23,000)
12 months or Longer, Number of Securities | security	3		4
Total, Fair Value	$ 3,914,000		$ 7,095,000
Total, Gross Unrealized Losses	$ (23,000)		$ (61,000)
Total, Number of Securities | security	6		9