Parent Company Only Financial Information (Condensed Statement of Financial Condition) (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2014	Dec. 31, 2013	Dec. 31, 2012	Dec. 31, 2011
Cash and Cash Equivalents, at Carrying Value	$ 35,451	$ 43,063	$ 43,063	$ 83,068
Equity method investments	1,300
Other Assets	21,853	28,830
Assets	1,332,296	1,334,046
Shareholders' equity	108,999	101,883	99,419
Liabilities and Stockholders' Equity	1,332,296	1,334,046
Parent Company [Member]
Cash and Cash Equivalents, at Carrying Value	1,036	3,025	2,449
Equity method investments	150,209	152,254
Investment in non-bank subsidiaries	1,255	4,036
Other Assets	5,872	4,031
Assets	158,372	163,346
Accrued Liabilities and Other Liabilities	2,643	14,733
Dividends Payable	0	0
Junior Subordinated Notes	46,730	46,730
Shareholders' equity	108,999	101,883
Liabilities and Stockholders' Equity	$ 158,372	$ 163,346