Fair Value Accounting and Measurement - Schedule of Assets and Liabilities Measured at Fair Value on a Recurring Basis (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	$ 317,520	$ 315,580
Level 1
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Level 2
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	317,520	315,580
Level 3
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	317,520	315,580
Recurring | Municipal bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	52,254	39,282
Recurring | ABS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	42,125	28,858
Recurring | ABS corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	34,073	40,855
Recurring | Corporate debt
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	9,439	9,643
Recurring | SBA
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	25,363	28,459
Recurring | MBS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	145,139	160,167
Recurring | MBS corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	9,127	8,316
Recurring | Level 1
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 1 | Municipal bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 1 | ABS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 1 | ABS corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 1 | Corporate debt
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 1 | SBA
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 1 | MBS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 1 | MBS corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 2
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	317,520	315,580
Recurring | Level 2 | Municipal bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	52,254	39,282
Recurring | Level 2 | ABS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	42,125	28,858
Recurring | Level 2 | ABS corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	34,073	40,855
Recurring | Level 2 | Corporate debt
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	9,439	9,643
Recurring | Level 2 | SBA
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	25,363	28,459
Recurring | Level 2 | MBS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	145,139	160,167
Recurring | Level 2 | MBS corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	9,127	8,316
Recurring | Level 3
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 3 | Municipal bonds
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 3 | ABS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 3 | ABS corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 3 | Corporate debt
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 3 | SBA
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 3 | MBS agency
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	0	0
Recurring | Level 3 | MBS corporate
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investment securities available for sale, at fair value	$ 0	$ 0