Consolidated Statements of Cash Flows - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2016	Dec. 31, 2015	Dec. 31, 2014
Cash flows from operating activities
Net income	$ 15,684	$ 15,385	$ 10,136
Adjustments to reconcile net income to net cash provided by (used in) operating activities:
Depreciation and amortization of leasehold improvement	2,288	2,386	2,485
Change in fair value of mortgage servicing rights	919	1,141	1,214
Loan loss reserve release	750	(4,400)	(3,300)
Provision for deferred tax expense	8,421	8,756	5,563
Originations of loans held-for-sale	(194,901)	(190,041)	(122,996)
Proceeds from sales of loans held-for-sale	197,654	196,431	124,458
Net gain on sales of mortgage loans	(6,343)	(5,775)	(3,594)
Net discount accretion of purchase accounting adjustment on loans	(605)
Change in current income taxes receivable (payable)	260	100	86
Increase in cash surrender value of bank-owned life insurance	(1,283)	(1,277)	(1,453)
Death claim on bank owned life insurance		273
Change in accrued interest receivable and other assets	(53)	(4,213)	(573)
Change in accrued interest payable and other liabilities	967	(2,668)	(20,001)
Net discount (accretion)/premium amortization on securities	(638)	79	(1,824)
Securities losses, net	2,213	178	(1,719)
Amortization of core deposit	16		1,177
Amortization of junior subordinated debentures issuance costs	48	47	48
Amortization of senior notes issuance costs	4
Stock based compensation	657	613	295
Net gain on sale of other real estate owned	(374)	(1,073)	(989)
Provision for other real estate owned losses	1,570	4,076	4,559
Net loss on disposal of fixed assets	1	(20)
Loss on transfer of premises to other real estate owned		1,139	121
Net cash provided by (used in) operating activities	27,255	21,137	(6,307)
Cash flows from investing activities
Proceeds from maturities and calls including pay down of securities available-for-sale	78,305	46,230	16,520
Proceeds from sales of securities available-for-sale	306,400	70,176	296,013
Purchases of securities available-for-sale	(210,681)	(196,082)	(325,020)
Proceeds from maturities and calls including pay down of securities held-to-maturity	3,372	13,281	9,703
Purchases of securities held-to-maturity			(11,212)
Proceeds from sales of Federal Home Loan Bank stock	600	540	1,234
Net change in loans	(125,539)	16,073	(74,338)
Improvements in other real estate owned	(16)		(794)
Proceeds from sales of other real estate owned	7,830	18,836	22,857
Proceeds from disposition of premises and equiment		30	1
Net purchases of premises and equipment	(1,986)	(1,280)	(1,097)
Cash paid for acquisition, net of cash and cash equivalent retained	(181,357)
Net cash (used in) provided by investing activities	(123,072)	(32,196)	(66,133)
Cash flows from financing activities
Net change in deposits	58,805	74,031	2,927
Net change in securities sold under repurchase agreements	(8,355)	13,034	(1,524)
Net change in other short-term borrowings	55,000	(30,000)	40,000
Redemption of preferred stock		(47,331)	(24,321)
Proceeds from issuance of common stock			64,331
Proceeds from the issuance of senior notes	43,994
Repayment of subordinate debt	(45,000)
Repayment of note payable	(500)
Proceeds from exercise of stock options	11
Dividends paid on preferred stock		(2,417)	(12,390)
Dividends paid common stock	(888)
Purchase of treasury stock	(254)	(117)	(46)
Net cash (used in) provided by financing activities	102,813	7,200	68,977
Net change in cash and cash equivalents	6,996	(3,859)	(3,463)
Cash and cash equivalents at beginning of period	40,338	44,197	47,660
Cash and cash equivalents at end of period	47,334	40,338	44,197
Supplemental cash flow information
Income taxes paid	211	118	40
Interest paid for deposits	4,275	3,958	5,533
Interest paid for borrowings	5,330	5,142	22,708
Non-cash transfer of loans to other real estate owned	1,223	8,530	13,918
Non-cash transfer of premises to other real estate owned	562	468	2,160
Non-cash transfer of securities available-for-sale to securities held-to-maturity	$ 244,823
Change in dividends accrued		$ (544)	(9,112)
Accretion on preferred stock discount			$ 58