Transactions With Affiliates (Details) - USD ($)	12 Months Ended
	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Related Party Transaction [Line Items]
Deposits	$ 4,414,757,000	$ 4,621,784,000
Securities under agreements to resell, outstanding amount		46,250,000
Resource America, Inc. [Member]
Related Party Transaction [Line Items]
Rent expense	$ 9,000	112,000	$ 102,000
Percentage of expenses paid as rent (in hundredths)	50.00%
Atlas Energy, L.P. [Member]
Related Party Transaction [Line Items]
Rent expense	$ 35,000	104,000	$ 104,000
Percentage of expenses paid as rent (in hundredths)	50.00%
Affiliated Entity [Member]
Related Party Transaction [Line Items]
Deposits	$ 33,400,000	15,100,000
Directors, Executive Officers, Principal Stockholders and Affiliates [Member]
Related Party Transaction [Line Items]
Due from related parties	1,800,000	28,100,000
Loans to related parties	1,800,000	30,900,000
J.V.B. Financial Group, LLC (Formerly PrinceRidge Group LLC) [Member]
Related Party Transaction [Line Items]
Securities under agreements to resell, outstanding amount		$ 46,300,000
Former Chief Executive Officer [Member]
Related Party Transaction [Line Items]
Monthly service fee	$ 30,000