Fair Value (Schedule of Financial Instruments Utilizing Level 3 Inputs) (Details) (USD $)	12 Months Ended
	Dec. 31, 2014		Dec. 31, 2013
Servicing Asset at Fair Value, Amount [Roll Forward]
Balance at beginning of year
Acquisition of MSRs in connection with purchase of GMFS	32,300,337
Additions due to loans sold, servicing retained	2,763,014
Fair value adjustment:
Changes in assumptions	(1,420,925)	[1],[2]
Other changes	(263,448)	[2],[3]
Balance at December 31, 2014	33,378,978
Loan Purchase Commitments [Member]
Derivatives:
Beginning balance
Acquisition of GMFS
Change in unrealized gain or loss	4,037
Ending balance	4,037
Interest Rate Lock Commitments [Member]
Derivatives:
Beginning balance
Acquisition of GMFS	2,702,954
Change in unrealized gain or loss	(221,891)
Ending balance	2,481,063
Mortgage Loans Held for Investment [Member]
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Beginning balance	331,785,542
Total net transfers into/out of Level 3
Acquisitions	85,579,169		334,162,044
Proceeds from sales
Net accretion of discounts	7,497,341		3,059,231
Proceeds from principal repayments	(31,759,326)		(13,871,059)
Conversion of mortgage loans to REO	(1,796,028)
Total losses (realized / unrealized) included in earnings	(8,250,003)		(6,344,877)
Total gains (realized / unrealized) included in earnings	32,903,143		14,780,203
Ending balance	415,959,838		331,785,542
The amount of total gains or (losses) for the period included in earnings attributable to the change in unrealized gains or losses relating to assets or liabilities still held at the reporting date	22,957,500		7,136,482
Real Estate Securities [Member]
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Beginning balance	226,155,221		100,911,651
Total net transfers into/out of Level 3
Acquisitions	47,034,327		234,397,506
Proceeds from sales	(102,635,229)		(68,190,593)
Net accretion of discounts	5,528,538		3,727,702
Proceeds from principal repayments	(28,197,740)		(39,338,730)
Conversion of mortgage loans to REO
Total losses (realized / unrealized) included in earnings	(6,694,487)		(9,138,009)
Total gains (realized / unrealized) included in earnings	7,395,103		3,785,694
Ending balance	148,585,733		226,155,221
The amount of total gains or (losses) for the period included in earnings attributable to the change in unrealized gains or losses relating to assets or liabilities still held at the reporting date	(1,039,499)		(2,822,969)
Other Investment Securities [Member]
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
Beginning balance
Total net transfers into/out of Level 3
Acquisitions	12,926,953
Proceeds from sales	(11,067,378)
Net accretion of discounts	180,438
Proceeds from principal repayments
Conversion of mortgage loans to REO
Total losses (realized / unrealized) included in earnings	(226,224)
Total gains (realized / unrealized) included in earnings	226,743
Ending balance	2,040,532
The amount of total gains or (losses) for the period included in earnings attributable to the change in unrealized gains or losses relating to assets or liabilities still held at the reporting date	(226,224)
Mortgage Servicing Rights [Member]
Fair Value, Assets Measured on Recurring Basis, Unobservable Input Reconciliation [Line Items]
The amount of total gains or (losses) for the period included in earnings attributable to the change in unrealized gains or losses relating to assets or liabilities still held at the reporting date	(1,420,925)
Servicing Asset at Fair Value, Amount [Roll Forward]
Balance at beginning of year
Acquisition of MSRs in connection with purchase of GMFS	32,300,337
Additions due to loans sold, servicing retained	2,763,014
Fair value adjustment:
Changes in assumptions	(1,420,925)	[1],[4]
Other changes	(263,448)	[4],[5]
Balance at December 31, 2014	$ 33,378,978

[1] Primarily reflects changes in prepayment assumptions due to changes in interest rates and discount rates.

[2] Included in change in fair value of MSRs in the Company's consolidated statements of operations.

[3] Represents decrease in value due to passage of time, including the impact from both regularly scheduled loan principal payments and loans that were paid off during the period.

[4] Included in change in fair value of MSRs on the consolidated statements of operations.

[5] Represents decrease in value due to passage of time, including the impact from both regularly scheduled loan principal payments and loans that were paid down or paid off during the period.