Fair Value Disclosures - Fair Value Measurements, Recurring and Nonrecurring (Details) - USD ($) $ in Thousands	Sep. 30, 2017	Dec. 31, 2016
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative Asset	$ 2,020	$ 23,182
Derivative Liability	5,516	32,509
Loans and Leases Receivable, Net Amount	5,127,770	4,507,435
Real estate owned, at lower of cost or fair value	1,086	1,528
Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative Asset	2,020	23,182
Assets, Fair Value Disclosure	7,695,596	7,413,106
Derivative Liability	30,595	58,152
Financial and Nonfinancial Liabilities, Fair Value Disclosure	30,595	58,152
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative Asset	50	0
Assets, Fair Value Disclosure	763,856	821,489
Derivative Liability	0	155
Financial and Nonfinancial Liabilities, Fair Value Disclosure	0	155
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative Asset	1,970	23,182
Assets, Fair Value Disclosure	1,450,154	1,699,814
Derivative Liability	30,595	57,997
Financial and Nonfinancial Liabilities, Fair Value Disclosure	30,595	57,997
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative Asset	0	0
Assets, Fair Value Disclosure	5,481,586	4,891,803
Derivative Liability	0	0
Financial and Nonfinancial Liabilities, Fair Value Disclosure	0	0
Fair Value, Measurements, Nonrecurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	1,091	3,148
Loans and Leases Receivable, Net Amount	636	2,799
Real estate owned, at lower of cost or fair value	455	349
Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	0	0
Loans and Leases Receivable, Net Amount	0	0
Real estate owned, at lower of cost or fair value	0	0
Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	0	0
Loans and Leases Receivable, Net Amount	0	0
Real estate owned, at lower of cost or fair value	0	0
Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	1,091	3,148
Loans and Leases Receivable, Net Amount	636	2,799
Real estate owned, at lower of cost or fair value	455	349
Farmer Mac Guaranteed Securities [Member] | Available-for-sale Securities [Member] | Institutional Credit [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	5,443,746	4,853,685
Farmer Mac Guaranteed Securities [Member] | Available-for-sale Securities [Member] | Institutional Credit [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Farmer Mac Guaranteed Securities [Member] | Available-for-sale Securities [Member] | Institutional Credit [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Farmer Mac Guaranteed Securities [Member] | Available-for-sale Securities [Member] | Institutional Credit [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	5,443,746	4,853,685
Farmer Mac Guaranteed Securities and USDA Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	5,443,746	4,853,685
Farmer Mac Guaranteed Securities and USDA Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Farmer Mac Guaranteed Securities and USDA Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Farmer Mac Guaranteed Securities and USDA Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	5,443,746	4,853,685
Investment Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		2,515,851
Investment Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		821,489
Investment Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		1,676,632
Investment Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		17,730
Investment Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	2,234,966
Investment Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	763,806
Investment Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	1,448,184
Investment Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	22,976
USDA Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	14,864	20,388
USDA Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
USDA Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
USDA Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	14,864	20,388
USDA Securities [Member] | Trading Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	14,864	20,388
USDA Securities [Member] | Trading Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
USDA Securities [Member] | Trading Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
USDA Securities [Member] | Trading Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	14,864	20,388
Floating Interest Rate [Member] | Floating rate auction-rate certificates backed by Government guaranteed student loans | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	18,518	17,730
Floating Interest Rate [Member] | Floating rate auction-rate certificates backed by Government guaranteed student loans | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Floating rate auction-rate certificates backed by Government guaranteed student loans | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Floating rate auction-rate certificates backed by Government guaranteed student loans | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	18,518	17,730
Floating Interest Rate [Member] | Asset-backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	35,602	43,851
Floating Interest Rate [Member] | Asset-backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Asset-backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	35,602	43,851
Floating Interest Rate [Member] | Asset-backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Corporate Debt Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		10,041
Floating Interest Rate [Member] | Corporate Debt Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		0
Floating Interest Rate [Member] | Corporate Debt Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		10,041
Floating Interest Rate [Member] | Corporate Debt Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		0
Floating Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	1,312,204	1,361,029
Floating Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	1,312,204	1,361,029
Floating Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Subordinated Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		66,953
Floating Interest Rate [Member] | Subordinated Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		0
Floating Interest Rate [Member] | Subordinated Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		66,953
Floating Interest Rate [Member] | Subordinated Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		0
Floating Interest Rate [Member] | Senior Agency Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	99,871	187,133
Floating Interest Rate [Member] | Senior Agency Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Senior Agency Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	99,871	187,133
Floating Interest Rate [Member] | Senior Agency Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Fixed Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	4,965	7,625
Fixed Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Fixed Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	507	7,625
Fixed Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	4,458	0
Fixed Interest Rate [Member] | US Treasury Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	763,806	821,489
Fixed Interest Rate [Member] | US Treasury Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	763,806	821,489
Fixed Interest Rate [Member] | US Treasury Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Fixed Interest Rate [Member] | US Treasury Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	$ 0	$ 0