Income Taxes - Summary of Tax Effects of Temporary Differences That Give Rise to Deferred Tax Assets and Deferred Tax Liabilities (Details) - USD ($) $ in Thousands	Dec. 31, 2023	Dec. 31, 2022
Deferred tax assets:
Net operating loss		$ 8,451
Mark-to-market on loans		355
Lease liability	$ 780	783
Stock compensation	1,779	1,485
Accrued vacation	386	283
Intangibles	3	5
REO	160
Deferred state taxes	374	696
Research and experimental expenditures capitalization	1,721
MSR Valuation Allowance	53
Derivative - OCI	427
ERC Refund	1,038
Other		154
Gross deferred tax assets	6,721	12,212
Deferred tax liabilities:
REMIC book-tax basis difference	(2,522)	(4,941)
Mark-to-market on loans	(36)
Right-of-use assets	(735)	(717)
Deferred origination costs	(63)	(138)
Property and equipment	(332)	(595)
REO		(30)
MSR valuation		(758)
Other	(694)
Gross deferred tax liabilities	(4,382)	(7,179)
Total net deferred tax asset	$ 2,339	$ 5,033