Other Real Estate Owned (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2017	Mar. 31, 2016	Dec. 31, 2016
Real Estate Properties [Line Items]
Mortgage Loans in Process of Foreclosure, Amount	$ 21,800		$ 21,782
Covered
Beginning balance	472	$ 6,817
Additions	0	3,936
Sales	(71)	(523)
Writedowns	(52)	(496)
Ending balance	349	9,734
Noncovered
Beginning balance	60,759	58,742
Additions	5,822	6,044
Sales	(9,048)	(7,547)
Writedowns	(1,391)	(2,235)
Ending balance	56,142	55,334
Total
Beginning balance	61,231	65,559
Additions	5,822	9,980
Sales	(9,119)	(8,070)
Writedowns	(1,443)	(2,731)
Ending balance	56,491	65,068
Mortgage
Total
Beginning balance	15,000
Ending balance	$ 15,200
North Milwaukee State Bank
Covered
Additions		0
Noncovered
Additions		330
Total
Additions		$ 330