Quarterly Financial Data (Unaudited) (Statement of Operations) (Details) - USD ($) $ / shares in Units, $ in Thousands	3 Months Ended								12 Months Ended
	Dec. 31, 2015	Sep. 30, 2015	Jun. 30, 2015	Mar. 31, 2015	Dec. 31, 2014	Sep. 30, 2014	Jun. 30, 2014	Mar. 31, 2014	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Interest income	$ 22,248	$ 21,193	$ 20,372	$ 19,717	$ 18,522	$ 18,033	$ 17,610	$ 16,555	$ 83,530	$ 70,720	$ 51,150
Net interest income	18,582	17,798	17,037	16,514	15,715	15,268	14,791	13,651	69,931	59,425	40,382
Provision for loan and lease losses	300	625	510	665	(1,404)	158	1,173	1,275	2,100	1,202	355
Non-interest income	70,267	17,299	24,724	20,777	17,675	20,307	23,389	23,678	133,067	85,049	82,073
Non-interest expense	58,999	47,795	46,434	40,860	37,628	33,135	34,012	31,205	194,088	135,980	101,817
Income (loss) from continuing operations before income tax expense	29,550	(13,323)	(5,183)	(4,234)	(2,834)	2,282	2,995	4,849	6,810	7,292	20,283
Income tax (benefit) provision	12,267	(5,706)	(2,684)	(2,427)	(13,929)	(3,560)	1,343	1,623	1,450	(14,523)	6,767
Net income (loss) from continuing operations	17,283	(7,617)	(2,499)	(1,807)	11,095	5,842	1,652	3,226	5,360	21,815	13,516
Net income (loss) from discontinued operations, net of tax	1,336	2,042	2,673	2,021	9,096	19,127	8,670	(1,599)	8,072	35,294	(27,938)
Net income (loss) available to common shareholders	$ 18,619	$ (5,575)	$ 174	$ 214	$ 20,191	$ 24,969	$ 10,322	$ 1,627	$ 13,432	$ 57,109	$ (14,422)
Net income (loss) per share from continuing operations - basic	$ 0.46	$ (0.20)	$ (0.07)	$ (0.05)	$ 0.31	$ 0.15	$ 0.04	$ 0.08	$ 0.14	$ 0.58	$ 0.36
Net income (loss) per share from discontinued operations - basic	0.04	0.05	0.07	0.05	0.24	0.51	0.23	(0.04)	0.21	0.94	(0.75)
Net income (loss) per share - basic	0.50	(0.15)			0.55	0.66	0.27	0.04	0.35	1.52	(0.39)
Net income (loss) per share from continuing operations - diluted	0.46	(0.20)	(0.07)	(0.05)	0.30	0.15	0.04	0.08	0.14	0.57	0.35
Net income (loss) per share from discontinued operations - diluted	0.04	0.05	$ 0.07	$ 0.05	0.22	0.51	0.23	(0.04)	0.21	0.92	(0.75)
Net income (loss) per share - diluted	$ 0.50	$ (0.15)			$ 0.52	$ 0.66	$ 0.27	$ 0.04	$ 0.35	$ 1.49	$ (0.40)
The Bancorp [Member]
Non-interest expense									$ 37,137	$ 32,351	$ 29,507
Income (loss) from continuing operations before income tax expense									13,432	56,221	(15,579)
Income tax (benefit) provision										(888)	(1,157)
Net income (loss) available to common shareholders									$ 13,432	$ 57,109	$ (14,422)