Income Taxes - Net Operating Loss Carryforwards (Details) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2012
Operating Loss Carryforwards
Loss Carryforwards	$ 96,985
Yadkin Valley Federal Tax
Operating Loss Carryforwards
Loss Carryforwards	47,892
Yadkin Valley State Tax
Operating Loss Carryforwards
Loss Carryforwards	46,324
Cardinal State Bank
Operating Loss Carryforwards
Loss Carryforwards	2,424
American Community Bank
Operating Loss Carryforwards
Loss Carryforwards	$ 345