Income Taxes - Net Operating Loss Carryforwards (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2012
Operating Loss Carryforwards
Loss Carryforwards	$ 96,985
Yadkin Valley Federal Tax
Operating Loss Carryforwards
Loss Carryforwards	47,892
Yadkin Valley State Tax
Operating Loss Carryforwards
Loss Carryforwards	46,324
Cardinal State Bank acquisition
Operating Loss Carryforwards
Loss Carryforwards	2,424
American Community Bank acquisition
Operating Loss Carryforwards
Loss Carryforwards	$ 345