Fair Value (Schedule of Quantitative Information about Level 3 Fair Value Measurements) (Details) (USD $)	12 Months Ended
	Dec. 31, 2014
Minimum [Member] | Interest Rate Lock Commitments [Member]
Unobservable Input
Pull-through rate	55.70%
Servicing fee multiple	0.4
Percentage of unpaid principal balance	0.20%
Maximum [Member] | Interest Rate Lock Commitments [Member]
Unobservable Input
Pull-through rate	100.00%
Servicing fee multiple	6.0
Percentage of unpaid principal balance	1.90%
Weighted Average [Member] | Interest Rate Lock Commitments [Member]
Unobservable Input
Pull-through rate	85.00%
Servicing fee multiple	4.4
Percentage of unpaid principal balance	1.10%
Mortgage Loans Held for Investment [Member] | Level 3 [Member]
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Fair Value	415,959,838
Mortgage Loans Held for Investment [Member] | Minimum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	1.40%
Constant default rate	0.00%
Loss severity	0.00%
Delinquency	0.10%
Mortgage Loans Held for Investment [Member] | Maximum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	27.10%
Constant default rate	4.00%
Loss severity	40.50%
Delinquency	13.60%
Mortgage Loans Held for Investment [Member] | Weighted Average [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	3.90%
Constant default rate	2.90%
Loss severity	23.80%
Delinquency	10.60%
Mortgage Servicing Rights [Member] | Level 3 [Member]
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Fair Value	33,378,978
Mortgage Servicing Rights [Member] | Minimum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	7.60%
Cost of servicing	76
Discount rate	9.00%
Mortgage Servicing Rights [Member] | Maximum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	58.20%
Cost of servicing	533
Discount rate	10.00%
Mortgage Servicing Rights [Member] | Weighted Average [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	10.60%
Cost of servicing	91
Discount rate	9.40%
Non-Agency RMBS [Member] | Level 3 [Member]
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Fair Value	148,585,733	[1]
Alternative - A [Member] | Level 3 [Member]
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Fair Value	61,296,540	[1]
Alternative - A [Member] | Minimum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	1.60%	[1]
Constant default rate	0.10%	[1]
Loss severity	0.00%	[1]
Delinquency	1.30%	[1]
Alternative - A [Member] | Maximum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	24.80%	[1]
Constant default rate	8.40%	[1]
Loss severity	81.10%	[1]
Delinquency	25.90%	[1]
Alternative - A [Member] | Weighted Average [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	13.60%	[1]
Constant default rate	3.10%	[1]
Loss severity	20.50%	[1]
Delinquency	10.10%	[1]
Pay Option Adjustable Rate [Member] | Level 3 [Member]
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Fair Value	45,541,325	[1]
Pay Option Adjustable Rate [Member] | Minimum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	1.70%	[1]
Constant default rate	1.60%	[1]
Loss severity	0.00%	[1]
Delinquency	6.80%	[1]
Pay Option Adjustable Rate [Member] | Maximum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	20.10%	[1]
Constant default rate	19.40%	[1]
Loss severity	66.20%	[1]
Delinquency	29.10%	[1]
Pay Option Adjustable Rate [Member] | Weighted Average [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	8.90%	[1]
Constant default rate	4.30%	[1]
Loss severity	38.00%	[1]
Delinquency	15.20%	[1]
Prime [Member] | Level 3 [Member]
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Fair Value	39,065,076	[1]
Prime [Member] | Minimum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	2.60%	[1]
Constant default rate	0.20%	[1]
Loss severity	0.00%	[1]
Delinquency	5.00%	[1]
Prime [Member] | Maximum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	17.30%	[1]
Constant default rate	9.20%	[1]
Loss severity	78.30%	[1]
Delinquency	24.80%	[1]
Prime [Member] | Weighted Average [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	9.20%	[1]
Constant default rate	4.10%	[1]
Loss severity	28.20%	[1]
Delinquency	13.00%	[1]
Subprime [Member] | Level 3 [Member]
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Fair Value	2,682,792	[1]
Subprime [Member] | Minimum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	2.40%	[1]
Constant default rate	6.00%	[1]
Loss severity	65.00%	[1]
Delinquency	25.50%	[1]
Subprime [Member] | Maximum [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	7.40%	[1]
Constant default rate	8.00%	[1]
Loss severity	85.00%	[1]
Delinquency	27.70%	[1]
Subprime [Member] | Weighted Average [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	4.70%	[1]
Constant default rate	7.70%	[1]
Loss severity	72.00%	[1]
Delinquency	26.80%	[1]
Other Investment Securities [Member] | Level 3 [Member]
Fair Value Inputs, Assets, Quantitative Information [Line Items]
Fair Value	2,040,532	[1]
Other Investment Securities [Member] | Weighted Average [Member] | Market Approach Valuation Technique [Member]
Unobservable Input
Constant voluntary prepayment	7.50%	[1]

[1] The Company uses third-party dealer quotes to estimate fair value of some of its financial assets. The Company verifies selected prices by using a variety of methods, including comparing prices to internally estimated prices and corroborating the prices by reference to other independent market data, such as relevant benchmark indices and prices of similar instruments. Where the Company has disclosed unobservable inputs for broker quotes or comparable trades, those inputs are based on the Company's validations performed at the security level.