CONSOLIDATED STATEMENTS OF OPERATIONS - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Interest income
Loans, including fees	$ 49,861	$ 36,459	$ 27,640
Interest on investment securities:
Taxable interest	19,918	20,662	15,999
Tax-exempt interest	10,820	11,345	4,758
Federal funds sold / securities purchased under agreements to resell	577	462	425
Interest earning deposits	2,354	1,792	2,328
Total interest income	83,530	70,720	51,150
Interest expense
Deposits	13,124	10,767	10,166
Securities sold under agreements to repurchase	15	50	54
Short-term borrowings	12
Subordinated debenture	448	478	548
Total interest expense	13,599	11,295	10,768
Net interest income	69,931	59,425	40,382
Provision for loan and lease losses	2,100	1,202	355
Net interest income after provision for loan and lease losses	67,831	58,223	40,027
Non-interest income
Service fees on deposit accounts	7,468	6,339	4,977
Card payment and ACH processing fees	5,731	5,402	4,046
Prepaid card fees	47,496	51,287	45,339
Gain on sale of loans	10,080	12,542	17,225
Gain on sales of investment securities	14,435	450	1,889
Gain on sale of health savings portfolio	33,531
Change in value of investment in unconsolidated entity	1,729
Other than temporary impairment on securities held-to-maturity			(20)
Leasing income	2,291	2,899	2,560
Debit card income	1,611	1,679	892
Affinity fees	3,358	2,596	2,986
Other	5,337	1,855	2,179
Total non-interest income	133,067	85,049	82,073
Non-interest expense
Salaries and employee benefits	68,390	60,509	52,248
Depreciation and amortization	4,747	4,523	3,694
Rent and related occupancy cost	5,659	4,694	3,858
Data processing expense	14,359	13,207	10,888
Printing and supplies	2,651	2,229	1,598
Audit expense	2,003	1,427	1,441
Legal expense	3,828	2,102	2,048
Amortization of intangible assets	1,186	1,211	1,142
FDIC Insurance	11,315	6,805	3,682
Software	7,222	4,908	3,553
Insurance	1,923	1,700	1,311
Telecom and IT network communications	2,016	2,531	1,483
Securitization and servicing expense	1,948	1,843	767
Consulting	4,333	3,452	1,700
Bank Secrecy Act and lookback consulting expenses	41,444	8,801
Other	21,064	16,038	12,404
Total non-interest expense	194,088	135,980	101,817
Income from continuing operations before income taxes	6,810	7,292	20,283
Income tax (benefit) provision	1,450	(14,523)	6,767
Net income from continuing operations	5,360	21,815	13,516
Income (loss) from discontinued operations before income taxes	12,793	54,625	(11,669)
Income tax provision	4,721	19,331	16,269
Income (loss) from discontinued operations, net of tax	8,072	35,294	(27,938)
Net income (loss) available to common shareholders	$ 13,432	$ 57,109	$ (14,422)
Net income (loss) per share from continuing operations - basic	$ 0.14	$ 0.58	$ 0.36
Net income (loss) per share from discontinued operations - basic	0.21	0.94	(0.75)
Net income (loss) per share - basic	0.35	1.52	(0.39)
Net income (loss) per share from continuing operations - diluted	0.14	0.57	0.35
Net income (loss) per share from discontinued operations - diluted	0.21	0.92	(0.75)
Net income (loss) per share - diluted	$ 0.35	$ 1.49	$ (0.40)