Consolidated Statements of Income - USD ($) $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2018	Sep. 30, 2018	Jun. 30, 2018	Mar. 31, 2018	Dec. 31, 2017	Sep. 30, 2017	Jun. 30, 2017	Mar. 31, 2017	Dec. 31, 2018		Dec. 31, 2017		Dec. 31, 2016
Income
Interest income	$ 16,958	$ 15,323	$ 12,019	$ 13,415	$ 14,037	$ 11,932	$ 10,002	$ 6,078	$ 57,715		$ 42,049		$ 30,722
Interest expense	10,385	9,257	7,324	7,543	7,062	6,096	4,292	2,431	34,509		19,881		7,808
Net interest income	6,573	6,066	4,695	5,872	6,975	5,836	5,710	3,647	23,206		22,168		22,914
Servicing fee income	16,574	14,017	11,535	8,650	7,660	6,307	5,493	4,574	50,776		24,034		7,579
Servicing costs	3,528	2,981	2,394	1,712	1,939	1,626	991	1,227	10,615		5,783		2,562
Net servicing income	13,046	11,036	9,141	6,938	5,721	4,681	4,502	3,347	40,161		18,251		5,017
Other income (loss)
Realized gain (loss) on RMBS, net	(2,932)	(428)	(121)	(4,881)	(1)	(169)	(77)	(256)	(8,362)		(503)		1,399
Realized gain on investments in Excess MSRs, net					0	0	0	6,678	0		6,678		1,520
Realized loss on derivatives, net	(3,162)	(707)	(2,033)	13	(1,260)	(1,480)	(1,797)	(1,017)	(5,889)		(5,554)		(7,963)
Unrealized gain on derivatives, net	(30,937)	8,807	6,009	19,626	8,447	1,684	(4,633)	1,082	3,505		6,580		12,080
Unrealized gain on investments in Excess MSRs					0	0	0	0	0		0		249
Unrealized gain (loss) on investments in MSRs	(21,924)	6,218	(365)	12,498	3,688	(2,334)	(4,507)	12,312	(3,573)		9,159		(3,285)
Total Income	(39,336)	30,992	17,326	40,066	23,570	8,218	(802)	25,793	49,048		56,779		31,931
Expenses
General and administrative expense	962	1,165	937	877	849	948	1,045	975	3,941		3,817		3,284
Management fee to affiliate	1,649	1,599	1,383	1,315	1,345	948	1,162	892	5,946		4,347		2,946
Total Expenses	2,611	2,764	2,320	2,192	2,194	1,896	2,207	1,867	9,887		8,164		6,230
Income Before Income Taxes	(41,947)	28,228	15,006	37,874	21,376	6,322	(3,009)	23,926	39,161		48,615		25,701
Provision for corporate business taxes	(3,137)	729	1,161	2,635	1,143	(537)	(1,344)	1,339	1,388	[1]	601	[1]	458	[1]
Net Income	(38,810)	27,499	13,845	35,239	20,233	6,859	(1,665)	22,587	37,773		48,014		25,243
Net income allocated to noncontrolling interests in Operating Partnership	505	(364)	(173)	(456)	(269)	(93)	119	(412)	(488)		(655)		(411)
Dividends on preferred stock	1,395	1,372	1,317	1,213	1,240	593	0	0	5,297		1,833		0
Net Income (Loss) Applicable to Common Stockholders	$ (39,700)	$ 25,763	$ 12,355	$ 33,570	$ 18,724	$ 6,173	$ (1,546)	$ 22,175	$ 31,988		$ 45,526		$ 24,832
Net Income Per Share of Common Stock
Basic (in dollars per share)	$ (2.42)	$ 1.62	$ 0.91	$ 2.64	$ 1.47	$ 0.49	$ (0.12)	$ 2.90	$ 2.18		$ 3.98		$ 3.31
Diluted (in dollars per share)	$ (2.42)	$ 1.62	$ 0.91	$ 2.64	$ 1.47	$ 0.49	$ (0.12)	$ 2.90	$ 2.18		$ 3.98		$ 3.30
Weighted Average Number of Shares of Common Stock Outstanding
Basic (in shares)	16,382,914	15,864,774	13,616,461	12,713,265	12,713,265	12,703,577	12,695,090	7,634,038	14,649,242		11,443,493		7,512,444
Diluted (in shares)	16,391,170	15,873,030	13,624,676	12,721,464	12,721,464	12,711,776	12,701,715	7,640,348	14,657,498		11,450,831		7,523,297

[1] The provision for income taxes is recorded at the TRS level.