Loans Receivable - SBA Loans (Details) - SBA Loans - USD ($) $ in Thousands	12 Months Ended
Dec. 31, 2019	Dec. 31, 2018	Dec. 31, 2017
SBA Loans [Line Items]
Loans serviced for others with participating interest, gross loan balance	$ 40,616	$ 54,335
SBA loans serviced for others with participating interest, participation balance owned by Bank	9,850	12,715
Servicing fee income and fees from SBA loans serviced for others	$ 459	$ 506	$ 467

Amount of derecognized financial assets from transactions which comprise an initial transfer and an agreement entered into in contemplation of the initial transfer resulting in retention of substantially all of the exposure to the economic return throughout the term of the transaction, at the date of derecognition.

Reference 1: http://fasb.org/us-gaap/role/ref/legacyRef
-Publisher FASB
-Name Accounting Standards Codification
-Topic 860
-SubTopic 20
-Section 50
-Paragraph 4D
-Subparagraph (a)
-URI http://asc.fasb.org/extlink&oid=109247956&loc=SL51823488-111719

Name:	us-gaap_TransferOfFinancialAssetsAccountedForAsSalesAmountDerecognized
Namespace Prefix:	us-gaap_
Data Type:	xbrli:monetaryItemType
Balance Type:	credit
Period Type:	instant