Income Taxes (Details) - USD ($) $ in Thousands		3 Months Ended
		Mar. 31, 2022	Mar. 31, 2021	Dec. 31, 2021
Income Taxes [Abstract]
Percentage of taxable income that must be distributed to qualify as a REIT		90.00%
Components of Income Tax Expense (Benefit) [Abstract]
Current federal income tax benefit		$ 0	$ (128)
Deferred federal income tax expense		3,295	3,240
Deferred state income tax expense		580	351
Provision for Corporate Business Taxes	[1]	3,875	3,463
Effective Income Tax Rate Reconciliation, Amount [Abstract]
Computed income tax expense at federal rate		6,847	5,185
State tax expense, net of federal tax, if applicable		459	351
REIT income not subject to tax (benefit)		(3,431)	(2,073)
Provision for Corporate Business Taxes	[1]	$ 3,875	$ 3,463
Effective Income Tax Rate Reconciliation, Percent [Abstract]
Computed income tax expense at federal rate		21.00%	21.00%
State tax expense, net of federal tax, if applicable		1.40%	1.40%
REIT income not subject to tax (benefit)		(10.50%)	(8.40%)
Provision for effective Tax Rate	[1]	11.90%	14.00%
Income taxes recoverable [Abstract]
Income taxes recoverable		$ 128		$ 128
Deferred tax assets [Abstract]
Deferred tax - mortgage servicing rights		5,605		10,539
Deferred tax - net operating loss		11,135		10,075
Total net deferred tax assets		16,740		$ 20,614
Net operating loss carryforwards		$ 46,700

[1] The provision for income taxes is recorded at the TRS level.