Operating Segments - Schedule of information about reportable segments (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2021	Dec. 31, 2020
Segment Reporting, Reconciling Item for Operating Profit (Loss) from Segment to Consolidated [Line Items]
Interest income	$ 47,543	$ 43,730
Interest expense	7,300	10,278
Net interest income	40,243	33,452
Provision for loan losses	(3,500)	16,900
Residential loan fee income	95,543	92,678
Internal transfer for portfolio loans originated	0	0
Noninterest Income, Other Miscellaneous	22,034	5,017
Total noninterest income	117,577	97,695
Total noninterest expense	128,842	98,469
Income before income tax expense	32,478	15,778
Income tax expense	7,860	3,075
Net income	24,618	12,703
Total assets	917,095	1,544,691
Operating Segments | Residential Mortgage
Segment Reporting, Reconciling Item for Operating Profit (Loss) from Segment to Consolidated [Line Items]
Interest income	3,717	2,684
Interest expense	2,480	1,914
Net interest income	1,237	770
Provision for loan losses	0	0
Residential loan fee income	95,543	92,678
Internal transfer for portfolio loans originated	336	35
Noninterest Income, Other Miscellaneous	49	64
Total noninterest income	95,928	92,777
Total noninterest expense	80,279	65,229
Income before income tax expense	16,886	28,318
Income tax expense	4,661	7,929
Net income	12,225	20,389
Total assets	115,810	217,422
Operating Segments | Banking
Segment Reporting, Reconciling Item for Operating Profit (Loss) from Segment to Consolidated [Line Items]
Interest income	43,826	41,046
Interest expense	4,820	8,364
Net interest income	39,006	32,682
Provision for loan losses	(3,500)	16,900
Residential loan fee income	0	0
Internal transfer for portfolio loans originated	(336)	(35)
Noninterest Income, Other Miscellaneous	21,985	4,953
Total noninterest income	21,649	4,918
Total noninterest expense	48,563	33,240
Income before income tax expense	15,592	(12,540)
Income tax expense	3,199	(4,854)
Net income	12,393	(7,686)
Total assets	$ 801,285	$ 1,327,269