Fair Value Disclosures - Fair Value Measurements, Recurring and Nonrecurring (Details) - USD ($) $ in Thousands	Jun. 30, 2017	Dec. 31, 2016
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative Asset	$ 5,546	$ 23,182
Derivative Liability	9,048	32,509
Loans and Leases Receivable, Net Amount	4,900,470	4,507,435
Real estate owned, at lower of cost or fair value	1,374	1,528
Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative Asset	5,546	23,182
Assets, Fair Value Disclosure	7,668,207	7,413,106
Derivative Liability	34,114	58,152
Financial and Nonfinancial Liabilities, Fair Value Disclosure	34,114	58,152
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative Asset	120	0
Assets, Fair Value Disclosure	758,200	821,489
Derivative Liability	0	155
Financial and Nonfinancial Liabilities, Fair Value Disclosure	0	155
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative Asset	5,426	23,182
Assets, Fair Value Disclosure	1,587,982	1,699,814
Derivative Liability	34,114	57,997
Financial and Nonfinancial Liabilities, Fair Value Disclosure	34,114	57,997
Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Derivative Asset	0	0
Assets, Fair Value Disclosure	5,322,025	4,891,803
Derivative Liability	0	0
Financial and Nonfinancial Liabilities, Fair Value Disclosure	0	0
Fair Value, Measurements, Nonrecurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	2,509	3,148
Loans and Leases Receivable, Net Amount	1,135	2,799
Real estate owned, at lower of cost or fair value	1,374	349
Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	0	0
Loans and Leases Receivable, Net Amount	0	0
Real estate owned, at lower of cost or fair value	0	0
Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	0	0
Loans and Leases Receivable, Net Amount	0	0
Real estate owned, at lower of cost or fair value	0	0
Fair Value, Measurements, Nonrecurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Assets, Fair Value Disclosure	2,509	3,148
Loans and Leases Receivable, Net Amount	1,135	2,799
Real estate owned, at lower of cost or fair value	1,374	349
Farmer Mac Guaranteed Securities [Member] | Available-for-sale Securities [Member] | Institutional Credit [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	5,282,562	4,853,685
Farmer Mac Guaranteed Securities [Member] | Available-for-sale Securities [Member] | Institutional Credit [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Farmer Mac Guaranteed Securities [Member] | Available-for-sale Securities [Member] | Institutional Credit [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Farmer Mac Guaranteed Securities [Member] | Available-for-sale Securities [Member] | Institutional Credit [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	5,282,562	4,853,685
Farmer Mac Guaranteed Securities and USDA Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	5,282,562	4,853,685
Farmer Mac Guaranteed Securities and USDA Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Farmer Mac Guaranteed Securities and USDA Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Farmer Mac Guaranteed Securities and USDA Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	5,282,562	4,853,685
Investment Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		2,515,851
Investment Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		821,489
Investment Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		1,676,632
Investment Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure		17,730
Investment Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	2,363,805
Investment Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	758,080
Investment Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	1,582,556
Investment Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	23,169
USDA Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	16,294	20,388
USDA Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
USDA Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
USDA Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	16,294	20,388
USDA Securities [Member] | Trading Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	16,294	20,388
USDA Securities [Member] | Trading Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
USDA Securities [Member] | Trading Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
USDA Securities [Member] | Trading Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	16,294	20,388
Floating Interest Rate [Member] | Floating rate auction-rate certificates backed by Government guaranteed student loans | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	18,518	17,730
Floating Interest Rate [Member] | Floating rate auction-rate certificates backed by Government guaranteed student loans | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Floating rate auction-rate certificates backed by Government guaranteed student loans | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Floating rate auction-rate certificates backed by Government guaranteed student loans | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	18,518	17,730
Floating Interest Rate [Member] | Asset-backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	37,423	43,851
Floating Interest Rate [Member] | Asset-backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Asset-backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	37,423	43,851
Floating Interest Rate [Member] | Asset-backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Corporate Debt Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	10,094	10,041
Floating Interest Rate [Member] | Corporate Debt Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Corporate Debt Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	10,094	10,041
Floating Interest Rate [Member] | Corporate Debt Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	1,355,482	1,361,029
Floating Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	1,355,482	1,361,029
Floating Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Subordinated Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	66,953
Floating Interest Rate [Member] | Subordinated Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Subordinated Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	66,953
Floating Interest Rate [Member] | Subordinated Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Senior Agency Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	179,029	187,133
Floating Interest Rate [Member] | Senior Agency Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Floating Interest Rate [Member] | Senior Agency Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	179,029	187,133
Floating Interest Rate [Member] | Senior Agency Debt [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Fixed Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	5,179	7,625
Fixed Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Fixed Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	528	7,625
Fixed Interest Rate [Member] | Government/GSE Guaranteed Mortgage Backed Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	4,651	0
Fixed Interest Rate [Member] | US Treasury Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	758,080	821,489
Fixed Interest Rate [Member] | US Treasury Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 1 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	758,080	821,489
Fixed Interest Rate [Member] | US Treasury Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 2 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	0	0
Fixed Interest Rate [Member] | US Treasury Securities [Member] | Available-for-sale Securities [Member] | Fair Value, Measurements, Recurring [Member] | Fair Value, Inputs, Level 3 [Member]
Fair Value, Assets and Liabilities Measured on Recurring and Nonrecurring Basis [Line Items]
Investments, Fair Value Disclosure	$ 0	$ 0