Regulatory Capital (Details) - USD ($) $ in Thousands	Jun. 30, 2015	Mar. 31, 2015	Dec. 31, 2014	Jun. 30, 2014	Mar. 31, 2014	Dec. 31, 2013
Regulatory Assets
Total stockholders' equity	$ 99,084		$ 116,559
Accumulated other comprehensive losses (gains)	300	$ 100	378	$ 895	$ 1,139	$ 1,057
Common equity Tier 1 capital	99,384		116,937
TRUPs	12,000		12,000
Tier 1 capital	111,384		128,937
Allowable reserve for credit losses other	8,757		8,537
Subordinated notes	23,000
Tier 2 capital	143,141		137,474
Risk-weighted assets ("RWA")	956,159		903,931
Average Assets ("AA")	$ 1,085,573		$ 1,053,424
Common Tier 1 capital to RWA	10.39%		12.94%
Tier 1 capital to RWA	11.65%		14.26%
Tier 2 capital to RWA	14.97%		15.21%
Tier 1 capital to AA (leverage)	10.26%		12.24%
Common Stock [Member]
Regulatory Assets
Total stockholders' equity	$ 99,084		$ 96,559
Preferred Stock, Senior Non-Cumulative Perpetual, Series C [Member]
Regulatory Assets
Total stockholders' equity			20,000
Bank [Member]
Regulatory Assets
Total stockholders' equity	130,922		126,838
Accumulated other comprehensive losses (gains)	300		378
Common equity Tier 1 capital	131,222		127,216
Tier 1 capital	131,222		127,216
Allowable reserve for credit losses other	8,757		8,537
Tier 2 capital	139,979		135,753
Risk-weighted assets ("RWA")	953,552		902,136
Average Assets ("AA")	$ 1,082,973		$ 1,051,627
Common Tier 1 capital to RWA	13.76%		14.10%
Tier 1 capital to RWA	13.76%		14.10%
Tier 2 capital to RWA	14.68%		15.05%
Tier 1 capital to AA (leverage)	12.12%		12.10%
Bank [Member] | Common Stock [Member]
Regulatory Assets
Total stockholders' equity	$ 130,922		$ 126,838