Securities - Schedule of Available for Sale Debt Securities in an Unrealized Loss Position (Details) - USD ($) $ in Thousands	Sep. 30, 2020	Dec. 31, 2019
Debt Securities, Available-for-sale [Line Items]
Less than 12 Months, Fair Value	$ 18,590	$ 65,611
Less than 12 Months, Unrealized Losses	(158)	(423)
12 Months or More, Fair Value	42,150	21,665
12 Months or More, Unrealized Losses	(301)	(95)
Total, Fair Value	60,740	87,276
Total, Unrealized Losses	(459)	(518)
U.S. Government agency obligations
Debt Securities, Available-for-sale [Line Items]
Less than 12 Months, Fair Value	0	0
Less than 12 Months, Unrealized Losses	0	0
12 Months or More, Fair Value	0	12,331
12 Months or More, Unrealized Losses	0	(34)
Total, Fair Value	0	12,331
Total, Unrealized Losses	0	(34)
Mortgage-backed securities, residential
Debt Securities, Available-for-sale [Line Items]
Less than 12 Months, Fair Value	127	3,549
Less than 12 Months, Unrealized Losses	(1)	(29)
12 Months or More, Fair Value	288	777
12 Months or More, Unrealized Losses	(2)	(7)
Total, Fair Value	415	4,326
Total, Unrealized Losses	(3)	(36)
Asset-backed securities
Debt Securities, Available-for-sale [Line Items]
Less than 12 Months, Fair Value	150	2,986
Less than 12 Months, Unrealized Losses	(1)	(36)
12 Months or More, Fair Value	6,941	4,973
12 Months or More, Unrealized Losses	(81)	(44)
Total, Fair Value	7,091	7,959
Total, Unrealized Losses	(82)	(80)
State and municipal
Debt Securities, Available-for-sale [Line Items]
Less than 12 Months, Fair Value	0	562
Less than 12 Months, Unrealized Losses	0	0
12 Months or More, Fair Value	0	3,426
12 Months or More, Unrealized Losses	0	(8)
Total, Fair Value	0	3,988
Total, Unrealized Losses	0	(8)
CLO securities
Debt Securities, Available-for-sale [Line Items]
Less than 12 Months, Fair Value	16,591	58,160
Less than 12 Months, Unrealized Losses	(144)	(358)
12 Months or More, Fair Value	34,739	0
12 Months or More, Unrealized Losses	(218)	0
Total, Fair Value	51,330	58,160
Total, Unrealized Losses	(362)	(358)
Corporate bonds
Debt Securities, Available-for-sale [Line Items]
Less than 12 Months, Fair Value	996	0
Less than 12 Months, Unrealized Losses	(7)	0
12 Months or More, Fair Value	150	149
12 Months or More, Unrealized Losses	0	(1)
Total, Fair Value	1,146	149
Total, Unrealized Losses	(7)	(1)
SBA pooled securities
Debt Securities, Available-for-sale [Line Items]
Less than 12 Months, Fair Value	726	354
Less than 12 Months, Unrealized Losses	(5)	0
12 Months or More, Fair Value	32	9
12 Months or More, Unrealized Losses	0	(1)
Total, Fair Value	758	363
Total, Unrealized Losses	$ (5)	$ (1)