Fair Value of Financial Instruments - Summary (Details) - USD ($) $ in Thousands	Sep. 30, 2019	Dec. 31, 2018
Assets:
Cash and due from banks	$ 22,856	$ 23,687
Federal funds sold and overnight interest-bearing deposits	21,559	18,396
Certificates of deposit in other banks	11,601	12,247
Available for sale securities	181,270	218,205
Mortgage servicing rights	2,575	2,931
Accrued interest receivable	6,215	6,162
Deposits:
Non-interest bearing demand	284,452	262,857
Savings, interest checking and money market	550,350	614,040
Operating lease liabilities	2,285
Accrued interest payable	1,020	1,035
Carrying Amount
Assets:
Cash and due from banks	22,856	23,687
Federal funds sold and overnight interest-bearing deposits	21,559	18,396
Certificates of deposit in other banks	11,601	12,247
Available for sale securities	181,270	218,205
Other investment securities	6,210	5,675
Loans, net	1,139,340	1,134,975
Mortgage servicing rights	2,575	2,931
Cash surrender value - life insurance	2,385	2,542
Accrued interest receivable	6,215	6,162
Assets, Total	1,394,011	1,424,820
Deposits:
Non-interest bearing demand	284,452	262,857
Savings, interest checking and money market	550,350	614,040
Time deposits	302,605	321,571
Federal funds purchased and securities sold under agreements to repurchase	27,191	24,647
Operating lease liabilities	2,285
Federal Home Loan Bank advances and other borrowings	106,980	95,153
Subordinated notes	49,486	49,486
Accrued interest payable	1,020	1,035
Liabilities, Total	1,324,369	1,368,789
Total Fair Value
Assets:
Cash and due from banks	22,856	23,687
Federal funds sold and overnight interest-bearing deposits	21,559	18,396
Certificates of deposit in other banks	11,601	12,247
Available for sale securities	181,270	218,205
Other investment securities	6,210	5,675
Loans, net	1,132,835	1,115,003
Mortgage servicing rights	2,575	2,931
Cash surrender value - life insurance	2,385	2,542
Accrued interest receivable	6,215	6,162
Assets, Total	1,387,506	1,404,848
Deposits:
Non-interest bearing demand	284,452	262,857
Savings, interest checking and money market	550,350	614,040
Time deposits	303,092	318,949
Federal funds purchased and securities sold under agreements to repurchase	27,191	24,647
Operating lease liabilities	2,285
Federal Home Loan Bank advances and other borrowings	93,751	94,326
Subordinated notes	43,393	45,749
Accrued interest payable	1,020	1,035
Liabilities, Total	1,305,534	1,361,603
Quoted Prices in Active Markets for Identical Assets (Level 1)
Assets:
Cash and due from banks	22,856	23,687
Federal funds sold and overnight interest-bearing deposits	21,559	18,396
Certificates of deposit in other banks	11,601	12,247
Available for sale securities	995	1,952
Other investment securities	13	12
Loans, net	0	0
Mortgage servicing rights	0	0
Cash surrender value - life insurance	0	0
Accrued interest receivable	6,215	6,162
Assets, Total	63,239	62,456
Deposits:
Non-interest bearing demand	284,452	262,857
Savings, interest checking and money market	550,350	614,040
Time deposits	0	0
Federal funds purchased and securities sold under agreements to repurchase	27,191	24,647
Operating lease liabilities	0
Federal Home Loan Bank advances and other borrowings	0	0
Subordinated notes	0	0
Accrued interest payable	1,020	1,035
Liabilities, Total	863,013	902,579
Other Observable Inputs (Level 2)
Assets:
Cash and due from banks	0	0
Federal funds sold and overnight interest-bearing deposits	0	0
Certificates of deposit in other banks	0	0
Available for sale securities	180,275	216,253
Other investment securities	6,197	5,663
Loans, net	0	0
Mortgage servicing rights	0	0
Cash surrender value - life insurance	2,385	2,542
Accrued interest receivable	0	0
Assets, Total	188,857	224,458
Deposits:
Non-interest bearing demand	0	0
Savings, interest checking and money market	0	0
Time deposits	0	0
Federal funds purchased and securities sold under agreements to repurchase	0	0
Operating lease liabilities	2,285
Federal Home Loan Bank advances and other borrowings	93,751	94,326
Subordinated notes	43,393	45,749
Accrued interest payable	0	0
Liabilities, Total	139,429	140,075
Significant Unobservable Inputs (Level 3)
Assets:
Cash and due from banks	0	0
Federal funds sold and overnight interest-bearing deposits	0	0
Certificates of deposit in other banks	0	0
Available for sale securities	0	0
Other investment securities	0	0
Loans, net	1,132,835	1,115,003
Mortgage servicing rights	2,575	2,931
Cash surrender value - life insurance	0	0
Accrued interest receivable	0	0
Assets, Total	1,135,410	1,117,934
Deposits:
Non-interest bearing demand	0	0
Savings, interest checking and money market	0	0
Time deposits	303,092	318,949
Federal funds purchased and securities sold under agreements to repurchase	0	0
Operating lease liabilities	0
Federal Home Loan Bank advances and other borrowings	0	0
Subordinated notes	0	0
Accrued interest payable	0	0
Liabilities, Total	$ 303,092	$ 318,949